NexusFi: Find Your Edge


Home Menu

 





Has anyone ever built any type of simple twitter scrapers before?


Discussion in Platforms and Indicators

Updated
    1. trending_up 793 views
    2. thumb_up 3 thanks given
    3. group 4 followers
    1. forum 4 posts
    2. attach_file 1 attachments




 
Search this Thread
  #1 (permalink)
 
forrestang's Avatar
 forrestang 
Chicago IL
Legendary Urban Samurai
 
Experience: None
Platform: Ninja, MT4, Matlab
Broker: CQG, AMP, MB, DTN
Trading: E/U, G/U
Posts: 1,345 since Jun 2010
Thanks Given: 357
Thanks Received: 1,060

Howdy gents.

I want to build a simple twitter scraper. Nothing fancy, just something where I can type a keyword or phrase/mention, E.g., "#China," or "@remi" or any single word, and it would return the dateTime, along with any number of things.

The number of things, would like just be somehting storing a counter, so I could see, say on 15Feb2024 2:05pm, 15 different mentions occured. I'd like to be able to plot this over time.

I've never done something like that, and my experience is pretty much basic coding in NT.

But, is this something feasible to do? If not, and I needed to pay someone to do it, does this sound complicated, and where should I look?

Just looking to get some ideas on where to start.

Any help would be appreciated,
FP


Started this thread Reply With Quote

Can you help answer these questions
from other members on NexusFi?
Iran Peace Expired NO: Ceasefire on Life Support, OPEC a …
Prediction Markets & Event Contracts
Friday Update: Markets Now Pricing Fed Rate HIKES as Sta …
Traders Hideout
Synapse Pro - Trade Copier with topstep and MT5 integrat …
NinjaTrader
TradingView Opens Volume Footprint Data to Pine Script - …
TradingView
Beijing Summit Closes: Xi Pledges Hormuz Help -- $1.14B …
Prediction Markets & Event Contracts
 
Best Threads (Most Thanked)
in the last 7 days on NexusFi
Sober Journey With S&P
23 thanks
2026 Jlab journal
10 thanks
Algo automated / semi-automated trading anyone?
6 thanks
Lady Vols Primer: Trading Volatility Journal
6 thanks
2026 Fire Horse
5 thanks
  #2 (permalink)
 
forrestang's Avatar
 forrestang 
Chicago IL
Legendary Urban Samurai
 
Experience: None
Platform: Ninja, MT4, Matlab
Broker: CQG, AMP, MB, DTN
Trading: E/U, G/U
Posts: 1,345 since Jun 2010
Thanks Given: 357
Thanks Received: 1,060

I actually kinda got something working, should be able to get most of what I want. 🤔
2024-09-27_235642


Started this thread Reply With Quote
Thanked by:
  #3 (permalink)
 
AllSeeker's Avatar
 AllSeeker 
Mumbai, India
Pratik_4Clover
 
Experience: Beginner
Platform: TradingView & ZerodhaKite
Trading: NIFTY, BANKNIFTY
Frequency: Daily
Duration: Minutes
Posts: 1,533 since Jan 2019
Thanks Given: 5,601
Thanks Received: 5,315


That's pretty good!

Python or something else?

Also, do tell us how this could improve/help in trading?

It would be difficult to measure social media impact on price, more so difficult unless you have some weight allocation system. Or want to go manually and decide for yourself. Which might just beat the purpose of this, but that's also very cheap


____________________________________________________________________________________________________________________________________
"Be an observer, You are not your trading performance, Stop thinking so much, Eliminate/reduce social media activity, Accept the randomness" - Josh
Visit my NexusFi Trade Journal Reply With Quote
  #4 (permalink)
 
forrestang's Avatar
 forrestang 
Chicago IL
Legendary Urban Samurai
 
Experience: None
Platform: Ninja, MT4, Matlab
Broker: CQG, AMP, MB, DTN
Trading: E/U, G/U
Posts: 1,345 since Jun 2010
Thanks Given: 357
Thanks Received: 1,060


AllSeeker View Post

Also, do tell us how this could improve/help in trading?

It would be difficult to measure social media impact on price, more so difficult unless you have some weight allocation system. Or want to go manually and decide for yourself. Which might just beat the purpose of this, but that's also very cheap

This was for DEFI/crypto... specifically meme coins.

It's a completely different game than we may typically play w/Trad-FI.

Memecoins are run 100% on 'attention,' no real value. Purpose of data scraper, was a way to begin to quantify 'attention.'


Started this thread Reply With Quote
Thanked by:
  #5 (permalink)
 
AllSeeker's Avatar
 AllSeeker 
Mumbai, India
Pratik_4Clover
 
Experience: Beginner
Platform: TradingView & ZerodhaKite
Trading: NIFTY, BANKNIFTY
Frequency: Daily
Duration: Minutes
Posts: 1,533 since Jan 2019
Thanks Given: 5,601
Thanks Received: 5,315


forrestang View Post
This was for DEFI/crypto... specifically meme coins.

It's a completely different game than we may typically play w/Trad-FI.

Memecoins are run 100% on 'attention,' no real value. Purpose of data scraper, was a way to begin to quantify 'attention.'

Got it!

Thanks for sharing info


____________________________________________________________________________________________________________________________________
"Be an observer, You are not your trading performance, Stop thinking so much, Eliminate/reduce social media activity, Accept the randomness" - Josh
Visit my NexusFi Trade Journal Reply With Quote
Thanked by:




Last Updated on November 2, 2024


© 2026 NexusFi®, s.a., All Rights Reserved.
Av Ricardo J. Alfaro, Century Tower, Panama City, Panama, Ph: +507 833-9432 (Panama and Intl), +1 888-312-3001 (USA and Canada)
All information is for educational use only and is not investment advice. There is a substantial risk of loss in trading commodity futures, stocks, options and foreign exchange products. Past performance is not indicative of future results.
About Us - Contact Us - Site Rules, Acceptable Use, and Terms and Conditions - Downloads - Top
no new posts