Comments (3)
The Robinhood API that Robintrack pulls from is public and you're free to pull from it yourself. I limit Robintrack to hourly for a couple of reasons:
- There is some lag time in the data received from Robinhood, around less than an hour in my testing. Making more regular pulls will do little to provide value if data doesn't update that reguarly.
- I want to avoid hitting the Robinhood API more than necessary. It's provided publicly, but there is no documentation about it so I want to avoid making more requests than I need to.
I will not be increasing the frequency of scraping that Robintrack does, but as I mentioned the API endpoint from Robinhood is public so you're free to pull from it yourself. The full code for doing that is in this repository in the scraper
sub-directory, so you can use that as a guide if you'd like.
from robintrack.
The Robinhood API endpoint does have a rate limit imposed on it; I keep my scraping spaced out to respect it. As I said, it's undocumented, so you'll have to find the right spacing to respect it.
from robintrack.
Can you give me a hint ? Frequency is limited by the scraper or API?
from robintrack.
Related Issues (20)
- Last data is from 08-14-2020 HOT 3
- Add CSV download for current view of popularity changes page HOT 1
- Replace dashes to periods in symbol search
- Robintrack Popularity History compressed file is corrupted while the archive generates HOT 12
- Incrementally clear cache after update rather than all at once
- What is the purpose of the ssh_tunnel in Justfile HOT 2
- Error when fetching neighboring popularity stocks for most popular stock (F)
- Lock tokens seem to not get dropped sometimes
- Retry failed requests on the frontend indefinitely
- Calculating Popularity Value from cURL Request HOT 2
- Data Download not working on site HOT 4
- Stale Data? Symbols/Popularity JSON File Missing Ticker Symbols HOT 4
- Data Download on Site Contains Stale (7/18) Data HOT 1
- Data Download not working on site HOT 3
- MTCH missing data after Jun 30 HOT 1
- `popularity_history_exporter` Cron job? Website has stale data HOT 1
- Chart on number of new users vs time HOT 2
- Cryptos HOT 1
- Still working?
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from robintrack.