NexusFi: Find Your Edge


Home Menu

 





How much Money for faster Optimization Backtesting: Willing to Pay.


Discussion in NinjaTrader

Updated
      Top Posters
    1. looks_one kevinkdog with 7 posts (10 thanks)
    2. looks_two goodoboy with 6 posts (5 thanks)
    3. looks_3 shade9281 with 3 posts (0 thanks)
    4. looks_4 Fu510n with 1 posts (0 thanks)
      Best Posters
    1. looks_one kevinkdog with 1.4 thanks per post
    2. looks_two shodson with 1 thanks per post
    3. looks_3 ShadowFox with 1 thanks per post
    4. looks_4 goodoboy with 0.8 thanks per post
    1. trending_up 8,239 views
    2. thumb_up 18 thanks given
    3. group 13 followers
    1. forum 22 posts
    2. attach_file 1 attachments




 
Search this Thread
  #21 (permalink)
shade9281
Hartford, Connecticut
 
Posts: 6 since Mar 2023
Thanks Given: 0
Thanks Received: 1


kevinkdog View Post
I would say what you programmed and backtested is not the same strategy as what you ran as actual. I don't know what is different, but there is probably an explanation. I'm sure one of the Ninja experts here would be happy to take a look.

so that's the thing - the strategy builder on nt generates the code for a strategy that can be uploaded to a chart or even applied to the strategy analyzer. unfortunately it actually is precisely the same code


Reply With Quote
  #22 (permalink)
 kevinkdog   is a Vendor
 
Posts: 3,737 since Jul 2012
Thanks Given: 1,917
Thanks Received: 7,470


shade9281 View Post
so that's the thing - the strategy builder on nt generates the code for a strategy that can be uploaded to a chart or even applied to the strategy analyzer. unfortunately it actually is precisely the same code

So then I would look at the settings on the chart/analyzer/replay. Something BIG must be different.

Your best bet is to post it (take out any stuff you want secret), and let people try to duplicate and debug.


Follow me on X Reply With Quote
Thanked by:
  #23 (permalink)
 sanlorenzo 
London UK
 
Experience: Intermediate
Platform: mc, nt, sierra, mt4/5
Trading: cable
Posts: 1 since Mar 2015
Thanks Given: 0
Thanks Received: 0


Fu510n View Post
https://forum.ninjatrader.com/forum/ninjatrader-8/platform-technical-support-aa/1128700-does-nt8-use-all-cores-threads-when-backtesting

...there are SO many ways to address this but you might want to start by "throwing hardware/cores at it". AMD Ryzen ThreadRipper CPUs can be purchased with 64/128 threads but those aren't cheap - if you're tied to cloud-based only, you can throw a lot of CPU horsepower there as well. Neither option is "cheap" but you didn't divulge exactly what you're trying to optimize (length/size of data, # parameters being optimized, etc.).

I thought that some years ago, and splashed a chunk of change on a 44C/88T dual xeon workstation, with 1TB of DDR4-2400Mhz ECC RAM and a 4TB PCIE NVME Raid array, for my personal use with NT8. Sadly I found that no matter what I did (I'm not a coder, just a technically aware trader that works with a team of pro C/C# coders), NT8 still only works about 6 or 7 of those 44 cores at anywhere near capacity (typically about 20% of available total cpu time) . So chucking cores at it doesn't really work well. I know the issues with using large amounts (eg. >5yrs) of tick data across multiple symbols. Its not easy to cut down the run-time. Its even harder if you have to use NT8 as your backtest/optimisation platform. My firm built its own platform at a cost of several £MM, largely to address these issues. So IMHO unless you're working towards a large, scalable automated system with its own OMS/EMS platform, you're better off developing an NT8 algo that has to be re-tuned every few weeks/months, rather than seeking to build a self-tuning algo using years of tick data, "chunking" it, running each chunk in parallel and then stitching it back together. For NT8 I suggest using a box with high performance characteristics on single-core benchmarks, e.g. an i9-13900HX with a generous helping of the fastest DDR5 RAM or similar. You do still benefit from multiple cores, but NT8's multi-threading in backtest/optimisation work is poor, partly due to its architecture, and partly due to the "tyranny of numbers" issue when working with time-series. At least this is my experience with it over the last 6 years or so.


Reply With Quote




Last Updated on June 16, 2023


© 2026 NexusFi®, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Downloads - Top
no new posts