Exception 'Unable to find guest token' raised when scraping replies approximately 33% of the time about snscrape_twitter HOT 2 OPEN

Hey,

I'm encountering a similar problem. Gut is a internal request limit is hit after x records.

from snscrape_twitter.

Hey,

I'm encountering a similar problem. Gut is a internal request limit is hit after x records.

I'm encountering this on Jupyter Notebook python 3.8. I am still determining how often this occurring.
I have been running the package for non-stop for a day or two. The trend I notice was that once the exception is hit, a certain period after would have same repeated exceptions. However, after some time (still figuring out how long exactly), it resumes.

Remark: I have been scraping tweets for particular constituents of index across a calendar year. I usually got a day of tweets for most of the constituents, hitting exception, and 5-6 days of blank results. After that, I got another day of tweets for most of the text queries.

I am attempting to pause the program for a defined amount of time once this exception is met, attempting to improve the data completeness of the scraped tweets.

Anyone has other idea on the workaround?

from snscrape_twitter.