jhnwr / asin-scraper Goto Github PK

Hello,

I run this code on a Raspberry Pi, and I have faced some issues that I have found solution.
For example the Chromium installed by default do not match an ARM based device like Raspberry Pi. Install Chromium before.

But here I couldn't find much info about Pyppeteer, and I face the following issue:
File "/home/pi/scripts/AmazonANSIScraper.py", line 27, in
r.html.render(sleep=1)
File "/usr/local/lib/python3.9/dist-packages/requests_html.py", line 598, in render
content, result, page = self.session.loop.run_until_complete(self._async_render(url=self.url, script=script, sleep=sleep, wait=wait, content=self.html, reload=reload, scrolldown=scrolldown, timeout=timeout, keep_page=keep_page))
File "/usr/lib/python3.9/asyncio/base_events.py", line 642, in run_until_complete
return future.result()
File "/usr/local/lib/python3.9/dist-packages/requests_html.py", line 512, in _async_render
await page.goto(url, options={'timeout': int(timeout * 1000)})
File "/usr/local/lib/python3.9/dist-packages/pyppeteer/page.py", line 837, in goto
raise error
pyppeteer.errors.TimeoutError: Navigation Timeout Exceeded: 8000 ms exceeded.

If anyone has a solution to propose ? I already tried to add some Timeout, but the error stay the same.