Comments (5)
实时逐笔并不是用http抓取的呢,是websocket推送的,建立了连接以后就不存在再次建立连接的问题,所以也不存在访问频率高的问题呢。
另外,逐笔是可以通过一个http接口在盘后(盘中也可以)进行查询的,查看SinaVendor。实时的话肯定不可能用http抓。
另外新浪是封了阿里云的部分节点ip的。
from dhydra.
@Emptyset110 多谢你的解答~
如果采用websocket实时同步逐笔数据的话,是不是每支股票都需要一个websocket?
直接采用SinaLevel2WSProducer
类的话,可以使用3000个股票代码作为symbols
初始化参数吗?
如果采用上面做法的话,会不会由于websocket并发太多,而被新浪屏蔽。
比如说,新浪会不会限制每个账号的并发websocket数量?
因为我的最终需求是,实时同步全部股票的逐笔数据,非常担心并发量太大而被新浪屏蔽。。。
from dhydra.
@sulinixl 并发太高是否会被封这个问题,我只能说最终解释权属于新浪(全市场的行情和逐笔我同时获取过,过去没被封不代表将来不被封)。新浪是知道我们这样获取的,在购买l2的按钮下面有一行小字,说禁止恶意抓取数据,不保证云服务器上可用……另外L2的实时逐笔的可靠性我还没验证(比如是否有漏)
from dhydra.
@Emptyset110 明白啦~ 多谢哈~
from dhydra.
这两天新浪的反爬似乎加强了
爬取盘后逐笔的时候每秒超过两个访问就被屏蔽了
from dhydra.
Related Issues (5)
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from dhydra.