Dark Theme
Light Theme
Trading Articles
Article Categories
Article Tools
Welcome to NexusFi: the best trading community on the planet, with over 150,000 members Sign Up Now for Free
Genuine reviews from real traders, not fake reviews from stealth vendors
Quality education from leading professional traders
We are a friendly, helpful, and positive community
We do not tolerate rude behavior, trolling, or vendors advertising in posts
We are here to help, just let us know what you need
You'll need to
register in order to view the content of the threads and start contributing to our community.
It's free for basic access, or support us by becoming an Elite Member -- see if you qualify for a discount below.
-- Big Mike, Site Administrator
(If you already have an account, login at the top of the page)
Updated June 22, 2024
Top Posters
looks_one
Big Mike
with 2,205 posts (3,943 thanks)
looks_two
bobwest
with 257 posts (494 thanks)
looks_3
xplorer
with 232 posts (387 thanks)
looks_4
SMCJB
with 99 posts (109 thanks)
Best Posters
looks_one
bobwest
with 1.9 thanks per post
looks_two
Big Mike
with 1.8 thanks per post
looks_3
xplorer
with 1.7 thanks per post
looks_4
SMCJB
with 1.1 thanks per post
trending_up
2,487,963 views
thumb_up
6,395 thanks given
group
169 followers
forum
3,970 posts
attach_file
576 attachments
June 27th, 2020, 02:43 PM
Blanes+ Girona/Spain
Posts: 2 since Jun 2020
Thanks Given: 8
Thanks Received: 0
Hello i'm new user from Barcelona..i trade futures on NT8..some good idea,indicators,strategy qnd VPS..i need some help..Thanks EveryBody.
Big Mike
The above was due to hardware changes for the site. I migrated to:
- 10th gen CPU, i9-10900X
- 128GB memory
- 8TB NVMe drive
As I mentioned many pages back as something I wanted to do... I left Google Cloud Compute and reverted back to something far simpler. Instead of a triple node MariaDB Galera replication system, with multiple physical nodes for the application servers, I reverted back to something that served us well for years. A single node setup.
Just like trading, you have to always be learning. The reason I went with GCP in the first place was because of rolling hardware upgrades and reliability, both having been the weak point of our old setup (aging hardware).
However, that aging hardware was mostly because we owned it and we co-lo'd into a datacenter. If I didn't own the hardware, I would have been more willing to ditch it earlier and upgrade in between Intel release cycles.
But GCP added complexity that proved to not solve problems for us, but create them, and it was also noticeably slower due to optimization for mutli-core deployments but at slower clock rates.
So I searched and found a high-clock rate replacement better suited for our workload. Less cores, but higher clock. I went with an i9-10900X for its stability, in a server class motherboard. Sure, we give up ECC ram but my experience tells me it's not important in real-world, where higher clock certainly is.
I also upgraded to an 8TB NVMe, specifically the HGST SN200. It can do 1.2M IOPS and 6GB/sec transfer, a significant improvement over anything we've had before.
When you look at our biggest threads, like the SP500 Spoonalysis thread, it was taking 2.5-3.0 seconds to load per page on the GCP hardware. Now we are down to less than 1 second, a massive improvement.
You should also see similar performance gains when creating a new post, as that was one of the slower aspects of the old system as well. The current bottleneck in that regard is related to the number of Followers in the thread, as notifications are processed in real-time when you submit the post (architecture of vb 3.8).
Since we gave up triple node redundancy with Galera, I am instead doing real-time hot backups of the databases using mydumper, combined with real-time file system sync using lsyncd. We have a much smaller backup node on a private VLAN at the same datacenter, to hold our backups and with the ability to step in at any time to replace the master in an emergency.
Anyway, having moved to Dockerized containers a while back, there is no real issue migrating from one host to another any longer. But please do report any problems, nonetheless.
Mike
Sent using the NexusFi mobile app
June 27th, 2020, 06:24 PM
Manta, Ecuador
Site Administrator Developer Swing Trader
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,607 since Jun 2009
Thanks Given: 33,345
Thanks Received: 101,971
xplorer
Yep, there seems to be a problem with some of the downloads
Alright, I've duplicated the problem. Let me see what is causing it...
Mike
June 27th, 2020, 07:03 PM
Manta, Ecuador
Site Administrator Developer Swing Trader
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,607 since Jun 2009
Thanks Given: 33,345
Thanks Received: 101,971
Big Mike
Alright, I've duplicated the problem. Let me see what is causing it...
Mike
Alright, should be solved @xplorer and @evevee please confirm.
Was an issue with 512-byte sector vs 4k sector alignment with XFS, when we migrated servers last time apparently we switched from a 512-byte sector to a 4k sector and nginx AIO/directio flag wasn't aligned properly.
I've been sick all week so haven't been on the site which is why it took so long to resolve. Plus this only affected files larger than 32M which is a minority.
Mike
June 28th, 2020, 03:13 AM
London UK
Experience: Beginner
Platform: CQG
Broker: S5
Trading: Futures
Posts: 6,010 since Sep 2015
Thanks Given: 15,589
Thanks Received: 15,556
NinjaCat68
Hello i'm new user from Barcelona..i trade futures on NT8..some good idea,indicators,strategy qnd VPS..i need some help..Thanks EveryBody.
Hi, depending on the help you need you may possibly post in a different thread.
What is it you need help with?
June 28th, 2020, 03:15 AM
London UK
Experience: Beginner
Platform: CQG
Broker: S5
Trading: Futures
Posts: 6,010 since Sep 2015
Thanks Given: 15,589
Thanks Received: 15,556
Big Mike
Seems okay now, thanks.
June 28th, 2020, 08:41 AM
investigating the steal
Experience: None
Platform: nobody interested
Broker: none
Trading: forget about it
Posts: 2,196 since Feb 2012
Thanks Mike for the big work on the site!
I find the new speed a tremendous advantage. Then I appreciate the much better function of pasting attachements and Images. And the lost phrase of "why do you udate this post?"-question which is a pain when running one post with several updates during a trade. Finally this helps to streamline the number of posts and all the information is collected in one. I even don't miss the titles for posts - as every user is more open to layout the posts within every thread with an own style. Great!
Seeing your attempt to streamlining the structure of the site with Site Administrator and Site Moderator I might need to change my "Legendary..." into "Site Influencer".
Happy weekend
GFIs1
June 28th, 2020, 10:27 AM
New York
Experience: Intermediate
Platform: Ninjatrader
Trading: ES
Posts: 6 since Feb 2012
Thanks Given: 4
Thanks Received: 0
It works. Thanks Mike. Take care.
July 2nd, 2020, 01:21 PM
London UK
Experience: Beginner
Platform: CQG
Broker: S5
Trading: Futures
Posts: 6,010 since Sep 2015
Thanks Given: 15,589
Thanks Received: 15,556
Brandenton
I can download, but there is nothing being replayed. Time progresses with no data.
Branderton, I had read this and meant to ask: did you solve this problem?
July 2nd, 2020, 02:14 PM
Virginia Beach, VA
Experience: Intermediate
Platform: NinjaTrader
Broker: TopStep
Trading: YM, MYM
Posts: 831 since Sep 2016
Thanks Given: 755
Thanks Received: 1,557
xplorer
Branderton, I had read this and meant to ask: did you solve this problem?
Yup, good to go. Thanks.
July 5th, 2020, 01:15 PM
Manta, Ecuador
Site Administrator Developer Swing Trader
Experience: Advanced
Platform: Custom solution
Broker: IBKR
Trading: Stocks & Futures
Frequency: Every few days
Duration: Weeks
Posts: 50,607 since Jun 2009
Thanks Given: 33,345
Thanks Received: 101,971
Numerous reports of 503 service errors this morning, should be resolved now. Please advise.
Mike
Last Updated on June 22, 2024