1.爬取百度百科 2.爬取百度词典
###推荐使用ide PyCharm
python3
pip install beautifulsoup4
python.exe spider_main.py
如果爬取不了,则百度修改了页面,根据页面修改爬取规则
fifths / python_baike_spider Goto Github PK
View Code? Open in Web Editor NEWpython_baike_spider 爬取百度百科信息demo
python_baike_spider's Introduction
python_baike_spider's People
Contributors
Stargazers
Watchers
Forkers
yipengmu kuanxh zhoutpython gogear777 guojianzhu flyky flyeven dataencoding coolwell xiao2mo xxdm lovecn zhipengtang zhao95 yuufish jesywang zwbai shonesolomon adrena-line zhaolei171226124 fengvs hxf007 imp-wang chenzhaohe ykingliu fozero jiaofengxianzi erictop3 luowenjuan colinsongf shadowcz007 mattzheng baifengbai xiaows08 kwzm li8182 teouue lumirr zzz68 hhy5277 wusir2001 dadax1404 hongyu9000 yuan963python_baike_spider's Issues
为什么爬下来的数据不是中文？
xb7\x9d\xe5\x8e\xbf\xef\xbc\x8c\xe6\x98\xaf\xe4\xb8\x80\xe5\x90\x8d\xe5\x89\x8dAV\xe5\xa5\xb3\xe4\xbc\x98\xe5\x92\x8c81Produce\xe7\x9a\x84\xe6\x9b\xbe\xe6\x89\x80\xe5\xb1\x9e\xe5\xa3\xb0\xe4\xbc\x98\xe3\x80\x822004\xe5\xb9\xb411\xe6\x9c\x8811\xe6\x97\xa5\xe5\x9b\xa0\xe8\xa2\xab\xe5\x85\xb6\xe5\xa3\xb0\xe4\xbc\x98\xe5\x85\xac\xe5\x8f\xb8\xe5\x8f\x91\xe7\x8e\xb0\xe5\x9c\xa8MOODYZ\xe6\x8b\x8d\xe6\x91\x84\xe5\xb0\x91\xe5\x84\xbf\xe4\xb8\x8d\xe5\xae\x9c\xe7\x94\xb5\xe5\xbd\xb1\xe8\x80\x8c\xe9\x81\xad\xe8\xa7\xa3\xe9\x9b\x87\xef\xbc\x8c\xe5\x90\x8c\xe6\x97\xb6\xe5\xbc\x95\xe9\x80\x80\xe4\xba\x86\xe5\xa3\xb0\xe4\xbc\x98\xe4\xb8\x8eAV\xe5\xa5\xb3\xe4\xbc\x98\xe7\x9a\x84\xe8\xa1\x8c\xe4\xb8\x9a\xe3\x80\x82\xe7\x9b\xb4\xe8\x87\xb3\xe7\x8e\xb0\xe5\x9c\xa8\xe8\xa1\x8c\xe8\xb8\xaa\xe4\xb8\x8d\xe6\x98\x8e\xe3
除了 url ，中文全是这样的，有什么办法吗？
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.