NexusFi: Find Your Edge


Home Menu

 





What are the problems with backtesting?


Discussion in Traders Hideout

Updated
      Top Posters
    1. looks_one jeffbg123 with 2 posts (0 thanks)
    2. looks_two dsherman with 1 posts (0 thanks)
    3. looks_3 Quick Summary with 1 posts (0 thanks)
    4. looks_4 Autobot with 1 posts (0 thanks)
    1. trending_up 4,390 views
    2. thumb_up 0 thanks given
    3. group 2 followers
    1. forum 4 posts
    2. attach_file 0 attachments




 
Search this Thread
  #1 (permalink)
 jeffbg123 
Chicago
 
Experience: Advanced
Platform: Other
Posts: 35 since Feb 2010
Thanks Given: 3
Thanks Received: 1

Hey,

I am relatively new to Ninjatrader and am using it for backtesting some strategies.

Besides for the obvious fact that curve fitting is evil and the past is not the future, what are the problems that can come out of backtesting?

In other words, if you run a backtest (with default filling) and it shows profit, then what are the reasons that it would not work in a live trading environment?

This is assuming a strategy is run with all limit orders off the market, so slippage should be negligible. I currently have a backtest for a winning strategy but it shows avg time in market = 0.0......how is this possible?

Thanks
-Jeff


Started this thread Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Trump Lands in Beijing on CPI Day: Iran Peace Expires To …
Prediction Markets & Event Contracts
Iran Fired a Missile at Israel Last Night. The $8M June …
Prediction Markets & Event Contracts
Would a node-based workflow for automated trading be useful?
Traders Hideout
Iran Peace Expired NO: Ceasefire on Life Support, OPEC a …
Prediction Markets & Event Contracts
World Cup Opens: USA at 45.5% Tonight as Markets Push Ba …
Prediction Markets & Event Contracts
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
NexusFi site changelog and issues/problem reporting
13 thanks
Darmok and Jalad at Tanagra
3 thanks
Big Mike in Ecuador
1 thanks
30 Sessions
1 thanks
  #3 (permalink)
 dsherman 
Michigan
 
Experience: Intermediate
Platform: NinjaTrader
Broker: Optimus/Vision & Stage5/Vision
Trading: Futures
Posts: 40 since Jul 2009
Thanks Given: 22
Thanks Received: 18


One thing I have seen is that when back testing, both with market replay and with backtest in the strategy analyzer, when using limit orders, Ninja has to "guess" if you bid or offer is hit if price just touched your price. It looks to me to be somewhat random and evens out 50% with you and 50% against you. However in live trading, whether or not your bid or offer gets hit is more likely to be in the opposite direction of what you want. So in short, during back testing you get a 50/50 chance of your bid/offer getting hit. during live trading, it will be perhaps 80/20 against you.


Reply With Quote
  #4 (permalink)
 jeffbg123 
Chicago
 
Experience: Advanced
Platform: Other
Posts: 35 since Feb 2010
Thanks Given: 3
Thanks Received: 1

Isnt that Default vs Liberal fill? I thought that default is worst case scenario where you are only filled if it completely trades through your price?

Also, I am having a problem where my entry and exit is executed at the same second and is always a 2 tick winner......Is this something in my code or a bug?


Started this thread Reply With Quote
  #5 (permalink)
Autobot
Ottawa, Canada
 
Posts: 22 since Nov 2009
Thanks Given: 4
Thanks Received: 12


jeffbg123 View Post
I am having a problem where my entry and exit is executed at the same second and is always a 2 tick winner......Is this something in my code or a bug?

Guess that would explain the positive ROI, eh? Could you post the code or a chart?


Reply With Quote




Last Updated on March 5, 2010


© 2026 NexusFi®, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Downloads - Top
no new posts