Comments (2)
Yes, you are right, however, this seems just WARNING, it still works.
I mean to replace threading with multiprocessing when starting a instance in the future develop.
from cola.
The SpannerOpener will be removed in the future, the selenium will be treated as the main solution to handle the dynamic webpage which may be generated by JS or Ajax etc.
from cola.
Related Issues (20)
- json.loads(br.response().read())["data"] HOT 1
- windows下coca无法启动分布式程序 HOT 1
- 遇到执行weibosearch的时候包不存在包问题 HOT 1
- 在CentOS 6中无法运行
- instances设置为大于core个数时,会出问题,过一段时间就会停止爬取了
- 在parser中获取网页html信息时卡住出不来
- 抓取网页出现HTTP ERROR处理问题
- 在抓取过程中突然卡住三四个小时,ctrl C不会退出。应该是mq处理出现问题了 HOT 1
- Failed to save to db, weakly-referenced object no longer exists HOT 2
- ValueError: No JSON object could be decoded HOT 8
- 怎么设置要爬取的用户 HOT 4
- 爬取follow列表的问题 HOT 2
- 爬取新浪微博出错 HOT 3
- 看了下,和上一个issues的log是一样的,应该是mq没有保护好的问题把
- 分布式爬取中,worker的主备mq同步问题
- 任务现场保存问题,任务现场保存在tmp里面,重启pc tmp会被清空
- 不太明白weibo.yaml里面的部分配置,有详细的一对一解释吗? HOT 2
- 还有更新的打算么? HOT 2
- 任务执行完成后为什么始终不退出 HOT 5
- Fix simple typo: falese -> false
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from cola.