NexusFi: Find Your Edge


Home Menu

 





Has anyone ever built any type of simple twitter scrapers before?


Discussion in Platforms and Indicators

Updated
    1. trending_up 271 views
    2. thumb_up 3 thanks given
    3. group 3 followers
    1. forum 4 posts
    2. attach_file 1 attachments




 
Search this Thread
  #1 (permalink)
 
forrestang's Avatar
 forrestang 
Chicago IL
Legendary Urban Samurai
 
Experience: None
Platform: Ninja, MT4, Matlab
Broker: CQG, AMP, MB, DTN
Trading: E/U, G/U
Posts: 1,343 since Jun 2010
Thanks Given: 356
Thanks Received: 1,055

Howdy gents.

I want to build a simple twitter scraper. Nothing fancy, just something where I can type a keyword or phrase/mention, E.g., "#China," or "@remi" or any single word, and it would return the dateTime, along with any number of things.

The number of things, would like just be somehting storing a counter, so I could see, say on 15Feb2024 2:05pm, 15 different mentions occured. I'd like to be able to plot this over time.

I've never done something like that, and my experience is pretty much basic coding in NT.

But, is this something feasible to do? If not, and I needed to pay someone to do it, does this sound complicated, and where should I look?

Just looking to get some ideas on where to start.

Any help would be appreciated,
FP

Started this thread Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Tech-Savvy Trader Seeking Collaboration with Trading Pla …
Emini and Emicro Index
NT8 coding values of "Additional Data"
NinjaTrader
Time, Futures, Scalping, Treasurys
Treasury Notes and Bonds
Cocretum bands convert to NinjaTrader8
NinjaTrader
NinjaTrader indicator for last bar percentages
NinjaTrader
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
The Program
9 thanks
HumbleTraders next chapter
5 thanks
Ninjatrader - Orderflow
4 thanks
A new (open source?) trading platform
4 thanks
Fighting Addiction and Stops
3 thanks
  #2 (permalink)
 
forrestang's Avatar
 forrestang 
Chicago IL
Legendary Urban Samurai
 
Experience: None
Platform: Ninja, MT4, Matlab
Broker: CQG, AMP, MB, DTN
Trading: E/U, G/U
Posts: 1,343 since Jun 2010
Thanks Given: 356
Thanks Received: 1,055

I actually kinda got something working, should be able to get most of what I want. 🤔
2024-09-27_235642

Started this thread Reply With Quote
Thanked by:
  #3 (permalink)
 
AllSeeker's Avatar
 AllSeeker 
Mumbai, India
Legendary Pratik_4Clover
 
Experience: Beginner
Platform: TradingView & ZerodhaKite
Trading: NIFTY, BANKNIFTY
Frequency: Daily
Duration: Minutes
Posts: 1,470 since Jan 2019
Thanks Given: 5,441
Thanks Received: 5,184


That's pretty good!

Python or something else?

Also, do tell us how this could improve/help in trading?

It would be difficult to measure social media impact on price, more so difficult unless you have some weight allocation system. Or want to go manually and decide for yourself. Which might just beat the purpose of this, but that's also very cheap

__________________________________________________________________________________________________________________________________________________________
"Be an observer, You are not your trading performance, Stop thinking so much, Eliminate/reduce social media activity, Accept the randomness" - Josh
Visit my NexusFi Trade Journal Reply With Quote
  #4 (permalink)
 
forrestang's Avatar
 forrestang 
Chicago IL
Legendary Urban Samurai
 
Experience: None
Platform: Ninja, MT4, Matlab
Broker: CQG, AMP, MB, DTN
Trading: E/U, G/U
Posts: 1,343 since Jun 2010
Thanks Given: 356
Thanks Received: 1,055


AllSeeker View Post

Also, do tell us how this could improve/help in trading?

It would be difficult to measure social media impact on price, more so difficult unless you have some weight allocation system. Or want to go manually and decide for yourself. Which might just beat the purpose of this, but that's also very cheap

This was for DEFI/crypto... specifically meme coins.

It's a completely different game than we may typically play w/Trad-FI.

Memecoins are run 100% on 'attention,' no real value. Purpose of data scraper, was a way to begin to quantify 'attention.'

Started this thread Reply With Quote
Thanked by:
  #5 (permalink)
 
AllSeeker's Avatar
 AllSeeker 
Mumbai, India
Legendary Pratik_4Clover
 
Experience: Beginner
Platform: TradingView & ZerodhaKite
Trading: NIFTY, BANKNIFTY
Frequency: Daily
Duration: Minutes
Posts: 1,470 since Jan 2019
Thanks Given: 5,441
Thanks Received: 5,184


forrestang View Post
This was for DEFI/crypto... specifically meme coins.

It's a completely different game than we may typically play w/Trad-FI.

Memecoins are run 100% on 'attention,' no real value. Purpose of data scraper, was a way to begin to quantify 'attention.'

Got it!

Thanks for sharing info

__________________________________________________________________________________________________________________________________________________________
"Be an observer, You are not your trading performance, Stop thinking so much, Eliminate/reduce social media activity, Accept the randomness" - Josh
Visit my NexusFi Trade Journal Reply With Quote
Thanked by:




Last Updated on November 2, 2024


© 2025 NexusFi®, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Privacy Policy - Sitemap - Downloads - Top
no new posts