Comments (6)
can you print the “loadMoreButton”? See if the element is correctly located and selected.
from python-for-data-and-media-communication-gitbook.
more details helps, eg the content of the element, its location, etc. Also, try the find elements (plural) version of the methods to see if more elements matched the CSS selector. Sometimes, you matched more. So the script clicked some other elements.
from python-for-data-and-media-communication-gitbook.
can you print the “loadMoreButton”? See if the element is correctly located and selected.
It yields invalid selector: Compound class names not permitted
, I follow the trick here solved this problem.
from python-for-data-and-media-communication-gitbook.
But another error occured NewConnectionError('<urllib3.connection.HTTPConnection object at 0x10d9766a0>: Failed to establish a new connection: [Errno 61] Connection refused'
.
I am wondering, instead of trying to click the button, is there other way to go to next page?
from python-for-data-and-media-communication-gitbook.
You can also try to to conduct network trace analysis —- some cases in our “advanced scraping” chapter, the open book
from python-for-data-and-media-communication-gitbook.
@ivyWANG958 , this is the section on network trace analysis: https://github.com/hupili/python-for-data-and-media-communication-gitbook/blob/master/notes-week-08.md#analyse-network-traces
from python-for-data-and-media-communication-gitbook.
Related Issues (20)
- datetime conversion HOT 1
- failed to open url with urllib.request HOT 6
- TODO marks in the source code HOT 4
- termtosvg may be useful for ch00 on Terminal/ Shell
- Fix per-chapter TOC in exported HTML/PDF
- clustering - Kmeans, Agglomerative, and DBSCAN HOT 3
- How to put User-Defined Image into the scatter diagram HOT 5
- How to merge grouped data HOT 3
- Add week 15 related case
- Some problems about return 'None' HOT 2
- prevent feedparser overwrite when scrape rss feed HOT 6
- ValueError: list.remove(x): x not in list HOT 1
- How to download CSV from GitHub HOT 1
- Test how to raise a quesion
- How to print csv file in Jupyter notebook HOT 3
- How to scrape all urls in one article HOT 2
- Chromedriver is not in the Path HOT 11
- cannot import Bar from pyecharts HOT 10
- Common methods to exit
Recommend Projects
-
React
A declarative, efficient, and flexible JavaScript library for building user interfaces.
-
Vue.js
🖖 Vue.js is a progressive, incrementally-adoptable JavaScript framework for building UI on the web.
-
Typescript
TypeScript is a superset of JavaScript that compiles to clean JavaScript output.
-
TensorFlow
An Open Source Machine Learning Framework for Everyone
-
Django
The Web framework for perfectionists with deadlines.
-
Laravel
A PHP framework for web artisans
-
D3
Bring data to life with SVG, Canvas and HTML. 📊📈🎉
-
Recommend Topics
-
javascript
JavaScript (JS) is a lightweight interpreted programming language with first-class functions.
-
web
Some thing interesting about web. New door for the world.
-
server
A server is a program made to process requests and deliver data to clients.
-
Machine learning
Machine learning is a way of modeling and interpreting data that allows a piece of software to respond intelligently.
-
Visualization
Some thing interesting about visualization, use data art
-
Game
Some thing interesting about game, make everyone happy.
Recommend Org
-
Facebook
We are working to build community through open source technology. NB: members must have two-factor auth.
-
Microsoft
Open source projects and samples from Microsoft.
-
Google
Google ❤️ Open Source for everyone.
-
Alibaba
Alibaba Open Source for everyone
-
D3
Data-Driven Documents codes.
-
Tencent
China tencent open source team.
from python-for-data-and-media-communication-gitbook.