Hi all,

I have been extensively testing several strategies using real time data from MB Trading. Having got to a point where a journal here at Mike's place would be a good idea, I started Market Replay to recreate my results (I am saving all the live data in NT).

Surprise! The market replay results are nothing like the real-time sim results. In real time, I do quite well. In market replay, I tank.

Has anyone else encountered this? I'm not really trading short time frames, so I doubt timing has much to do with it (five minute bars, trades of several hours).

What the heck? Any suggestions? Do you think my (sim) real-time data results are more accurate the the market replay results?

Looks like this guy had a similar issue:

Market replay v's Realtime data Hi I noticed something really strange the other day, I run a simple strategy on CL, came back from work and I was down -$10.000 (dont worry it was sim). I ran the same strategy on the same chart using market replay and I was down -$1000? Any idea …

Hi, sim trading uses a live data feed. This data is different than what is saved on the NinjaTrader historical data server and wherever they save the data for market replay downloads. The only way to have the same data as you saw live is to record your own.

Dan

eDanny 

Hi, sim trading uses a live data feed. This data is different than what is saved on the NinjaTrader historical data server and wherever they save the data for market replay downloads. The only way to have the same data as you saw live is to record your own. Dan

Hi Dan,

Thanks for the reply. Maybe I am confused?

I am saving my data for market replay (not at my NT computer right now, but it is somewhere buried in Options/Data). When I right-click on the Market Replay control box, the availiable data I have is what I recorded.

What I think I am seeing is an inconsistancy between sim trading performance and Market Replay performance. Market Replay performance is what is yielded from using the same data that I recorded while I was sim trading.

Then I have no explanation. Sorry.

serac 

What I think I am seeing is an inconsistancy between sim trading performance and Market Replay performance. Market Replay performance is what is yielded from using the same data that I recorded while I was sim trading.

Are you using an exotic bar type like Renko, LineBreak, etc?

Mike

Big Mike 

Are you using an exotic bar type like Renko, LineBreak, etc? Mike

Mike,

Good question - I didn't think to mention that.

No. Nothing exotic. Five-minute bars.

I have a mechanism built in the strategy using muti time frames to run at a higher resolution (still using five minute bars, but sending the orders on 200 tick bars). Originally I did this for backtesting, but have since completely given up the vice. Perhaps Market Replay will behave better using this configuration?

I am continuously modifying stop loss orders. Perhaps this is not functioning correctly in Replay?

Thanks for all y'all suggestions so far...

After a year of inconsistencies with market replay and backtesting using MTF designed to solve this problem with NinjaTrader, I just finally gave up and moved to MultiCharts. Sorry I can't be of more help.

Is it possible? Sure. You could land the space shuttle with NinjaTrader. Anything is possible with C#. But I just decided to move to something else. Hopefully someone else can help you find the problem. You might need to post your code.

Mike

Big Mike 

After a year of inconsistencies with market replay and backtesting using MTF designed to solve this problem with NinjaTrader, I just finally gave up and moved to MultiCharts. Sorry I can't be of more help. Is it possible? Sure. You could land the space shuttle with NinjaTrader. Anything is possible with C#. But I just decided to move to something else. Hopefully someone else can help you find the problem. You might need to post your code. Mike

Yeah, MultiCharts has crossed my mind more than once. Once I have myself convinced that some of my ideas might have an edge, I may do the MC plunge. The attractiveness of NT is the free development costs - I don't want to feel hurried, just want to do a good job.

How well does MC perform backtesting? Is it any more worthwhile than NT? I still find it hard to believe that NT backtesting is so unrealistic - the system is completely deterministic, and yet the results can be off an order of magnitude.

Oh. It is true you could land the space shuttle with C#. But, you also could do it with crappy language and teeny-tiny computer...

Thanks for your help, Mike.

serac 

Yeah, MultiCharts has crossed my mind more than once. Once I have myself convinced that some of my ideas might have an edge, I may do the MC plunge. The attractiveness of NT is the free development costs - I don't want to feel hurried, just want to do a good job. How well does MC perform backtesting? Is it any more worthwhile than NT? I still find it hard to believe that NT backtesting is so unrealistic - the system is completely deterministic, and yet the results can be off an order of magnitude. Oh. It is true you could land the space shuttle with C#. But, you also could do it with crappy language and teeny-tiny computer... Thanks for your help, Mike.

Better threads covering MultiCharts:

VIDEO: MultiCharts vs. NinjaTrader strategy backtesting and optimization In this video I conducted a head-to-head comparison of MultiCharts and NinjaTrader evaluating which performed better for backtesting and optimization. The data was provided by IQFeed, for ES S&P 500, 5-minute bars over a period of 2 years (3/22/2008 …

VIDEO TUTORIAL: How to create an advanced MultiCharts EasyLanguage Strategy Last year I did a video tutorial on creating an advanced NinjaTrader strategy, and you guys liked it. So I thought that since I don't use NT any more it would be a good idea to do the same strategy as an example in EasyLanguage with MultiCharts. First, …

MultiCharts, MultiCharts, MultiCharts... Well today after NT7 blew up on me again non-stop, I really got fed up and kicked into high gear. I'm looking at Neoticker ( as well as MultiCharts. But this thread will be about my experiences with MultiCharts. First, you can download MultiCharts …

Mike