NexusFi: Find Your Edge


Home Menu

 





How much data is needed?


Discussion in Traders Hideout

Updated
      Top Posters
    1. looks_one bukkan with 2 posts (0 thanks)
    2. looks_two Big Mike with 2 posts (0 thanks)
    3. looks_3 togier with 2 posts (0 thanks)
    4. looks_4 Fat Tails with 1 posts (0 thanks)
    1. trending_up 4,857 views
    2. thumb_up 0 thanks given
    3. group 4 followers
    1. forum 7 posts
    2. attach_file 0 attachments




 
Search this Thread
  #1 (permalink)
 togier 
Boston, MA
 
Experience: Advanced
Platform: NinjaTrader
Broker: IB
Trading: EUR/USD
Posts: 42 since Apr 2010
Thanks Given: 1
Thanks Received: 3

When developing an automated strategy, in your opinion, how much historical tick data would you need in order to feel comfortable with the results? This particular strategy is an automated scalping strategy trading off of Euro tick data.


Started this thread Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Friday Update: Markets Now Pricing Fed Rate HIKES as Sta …
Traders Hideout
Irans Dual Probability: Guns Quiet at 99.95% While Forma …
Prediction Markets & Event Contracts
The Great Rotation -- Small Caps Crushing Tech as Sectio …
Traders Hideout
CME Cuts Precious Metals Margins Up to 21% Starting Toda …
Commodities
Hungary Called for Magyar at 97pct, Ending 16-Year Orban …
Prediction Markets & Event Contracts
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Sober Journey With S&P
21 thanks
2026 Jlab journal
10 thanks
Algo automated / semi-automated trading anyone?
6 thanks
Lady Vols Primer: Trading Volatility Journal
6 thanks
Trying to learn Volume and price action correlation
5 thanks
  #3 (permalink)
 bukkan 
Calcutta, India
 
Experience: Intermediate
Platform: ArthaChitra
Posts: 278 since Jun 2009
Thanks Given: 161
Thanks Received: 271


watching some documentary where they criticized LTCM for backtesting only 5 years of data. had they backtested a bit more they could get a "feel" of the 1987 black monday.


Reply With Quote
  #4 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,669 since Jun 2009
Thanks Given: 33,669
Thanks Received: 102,557

You need to also factor in the frequency of trades.

For my backtests, I look for the strategy to trade at least 3-5 times a day and I optimize over at least 2 years of tick data. It is still very easy to over curve fit to data, but strategies that only trade once a day or once a week, etc, are obviously much easier to curve fit.

Mike




We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on X Visit my NexusFi Trade Journal Reply With Quote
  #5 (permalink)
 
Big Mike's Avatar
 Big Mike 
Manta, Ecuador
Site Administrator
Developer
Swing Trader
 
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,669 since Jun 2009
Thanks Given: 33,669
Thanks Received: 102,557


bukkan View Post
watching some documentary where they criticized LTCM for backtesting only 5 years of data. had they backtested a bit more they could get a "feel" of the 1987 black monday.

Which documentary? I like watching this type of stuff.

Mike




We're here to help: just ask the community or contact our Help Desk

Quick Links: Change your Username or Register as a Vendor
Searching for trading reviews? Review this list
Lifetime Elite Membership: Sign-up for only $149 USD
Exclusive money saving offers from our Site Sponsors: Browse Offers
Report problems with the site: Using the NexusFi changelog thread
Follow me on X Visit my NexusFi Trade Journal Reply With Quote
  #6 (permalink)
 bukkan 
Calcutta, India
 
Experience: Intermediate
Platform: ArthaChitra
Posts: 278 since Jun 2009
Thanks Given: 161
Thanks Received: 271


Big Mike View Post
Which documentary? I like watching this type of stuff.

Mike

sorry, dont remember the name.

same here. love to watch movies and docu on trading.

have a peep here. some nice series. YouTube - DarkAngelStarQ's Channel


Reply With Quote
  #7 (permalink)
 togier 
Boston, MA
 
Experience: Advanced
Platform: NinjaTrader
Broker: IB
Trading: EUR/USD
Posts: 42 since Apr 2010
Thanks Given: 1
Thanks Received: 3

I loved the video. I saw the movie that CNBC put out re: the Lehman collapse but I think the youtube video was even better. Anyway, the automated trading that I am doing places between 3 and 5 trades per day. That said, it sounds like I need to back test against 2 or more years of data.


Started this thread Reply With Quote
  #8 (permalink)
 
Fat Tails's Avatar
 Fat Tails 
Berlin, Europe
Market Wizard
 
Experience: Advanced
Platform: NinjaTrader
Broker: Interactive Brokers
Trading: Futures & Stocks
Posts: 9,887 since Mar 2010
Thanks Given: 4,242
Thanks Received: 27,114


bukkan View Post
watching some documentary where they criticized LTCM for backtesting only 5 years of data. had they backtested a bit more they could get a "feel" of the 1987 black monday.

They were backtesting on daily data. 5 years of data is equivalent to 1250 bars. This is insufficient anyway. 1 week of 5 min data of ES would be 1395 bars, which is about equivalent.

If the strategy makes 3 trades per day and you have two years of intraday data, then this would be roughly 1500 trades (750 per year), which is a good base. You can then divide the data into your backtest and the walk forward sample.


Reply With Quote




Last Updated on December 4, 2010


© 2026 NexusFi®, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Downloads - Top
no new posts