NexusFi: Find Your Edge


Home Menu

 





Has anyone ever built any type of simple twitter scrapers before?


Discussion in Platforms and Indicators

Updated
    1. trending_up 793 views
    2. thumb_up 3 thanks given
    3. group 4 followers
    1. forum 4 posts
    2. attach_file 1 attachments




 
Search this Thread
  #1 (permalink)
 
forrestang's Avatar
 forrestang 
Chicago IL
Legendary Urban Samurai
 
Experience: None
Platform: Ninja, MT4, Matlab
Broker: CQG, AMP, MB, DTN
Trading: E/U, G/U
Posts: 1,345 since Jun 2010
Thanks Given: 357
Thanks Received: 1,060

Howdy gents.

I want to build a simple twitter scraper. Nothing fancy, just something where I can type a keyword or phrase/mention, E.g., "#China," or "@remi" or any single word, and it would return the dateTime, along with any number of things.

The number of things, would like just be somehting storing a counter, so I could see, say on 15Feb2024 2:05pm, 15 different mentions occured. I'd like to be able to plot this over time.

I've never done something like that, and my experience is pretty much basic coding in NT.

But, is this something feasible to do? If not, and I needed to pay someone to do it, does this sound complicated, and where should I look?

Just looking to get some ideas on where to start.

Any help would be appreciated,
FP


Started this thread Reply With Quote

Can you help answer these questions
from other members on NexusFi?
White House Drops First Alien Files Today -- Market Says …
Prediction Markets & Event Contracts
May 26 Deadline Dies at 7.5% as US Strikes Iran During C …
Prediction Markets & Event Contracts
TradingView Opens Volume Footprint Data to Pine Script - …
TradingView
Prop Firms Are Banning Gold Trading as Record Prices Mak …
Funded Trading Evaluation Firms
Third Circuit Backs Kalshi in Landmark Ruling -- Predict …
Prediction Markets & Event Contracts
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Sober Journey With S&P
21 thanks
2026 Jlab journal
10 thanks
Algo automated / semi-automated trading anyone?
6 thanks
Lady Vols Primer: Trading Volatility Journal
6 thanks
Trying to learn Volume and price action correlation
5 thanks
  #2 (permalink)
 
forrestang's Avatar
 forrestang 
Chicago IL
Legendary Urban Samurai
 
Experience: None
Platform: Ninja, MT4, Matlab
Broker: CQG, AMP, MB, DTN
Trading: E/U, G/U
Posts: 1,345 since Jun 2010
Thanks Given: 357
Thanks Received: 1,060

I actually kinda got something working, should be able to get most of what I want. 🤔
2024-09-27_235642


Started this thread Reply With Quote
Thanked by:
  #3 (permalink)
 
AllSeeker's Avatar
 AllSeeker 
Mumbai, India
Pratik_4Clover
 
Experience: Beginner
Platform: TradingView & ZerodhaKite
Trading: NIFTY, BANKNIFTY
Frequency: Daily
Duration: Minutes
Posts: 1,533 since Jan 2019
Thanks Given: 5,601
Thanks Received: 5,315


That's pretty good!

Python or something else?

Also, do tell us how this could improve/help in trading?

It would be difficult to measure social media impact on price, more so difficult unless you have some weight allocation system. Or want to go manually and decide for yourself. Which might just beat the purpose of this, but that's also very cheap


____________________________________________________________________________________________________________________________________
"Be an observer, You are not your trading performance, Stop thinking so much, Eliminate/reduce social media activity, Accept the randomness" - Josh
Visit my NexusFi Trade Journal Reply With Quote
  #4 (permalink)
 
forrestang's Avatar
 forrestang 
Chicago IL
Legendary Urban Samurai
 
Experience: None
Platform: Ninja, MT4, Matlab
Broker: CQG, AMP, MB, DTN
Trading: E/U, G/U
Posts: 1,345 since Jun 2010
Thanks Given: 357
Thanks Received: 1,060


AllSeeker View Post

Also, do tell us how this could improve/help in trading?

It would be difficult to measure social media impact on price, more so difficult unless you have some weight allocation system. Or want to go manually and decide for yourself. Which might just beat the purpose of this, but that's also very cheap

This was for DEFI/crypto... specifically meme coins.

It's a completely different game than we may typically play w/Trad-FI.

Memecoins are run 100% on 'attention,' no real value. Purpose of data scraper, was a way to begin to quantify 'attention.'


Started this thread Reply With Quote
Thanked by:
  #5 (permalink)
 
AllSeeker's Avatar
 AllSeeker 
Mumbai, India
Pratik_4Clover
 
Experience: Beginner
Platform: TradingView & ZerodhaKite
Trading: NIFTY, BANKNIFTY
Frequency: Daily
Duration: Minutes
Posts: 1,533 since Jan 2019
Thanks Given: 5,601
Thanks Received: 5,315


forrestang View Post
This was for DEFI/crypto... specifically meme coins.

It's a completely different game than we may typically play w/Trad-FI.

Memecoins are run 100% on 'attention,' no real value. Purpose of data scraper, was a way to begin to quantify 'attention.'

Got it!

Thanks for sharing info


____________________________________________________________________________________________________________________________________
"Be an observer, You are not your trading performance, Stop thinking so much, Eliminate/reduce social media activity, Accept the randomness" - Josh
Visit my NexusFi Trade Journal Reply With Quote
Thanked by:




Last Updated on November 2, 2024


© 2026 NexusFi®, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Downloads - Top
no new posts