IP blocking about rewe-discounts HOT 7 CLOSED

Do you know when the block is triggered, i.e. how many requests in a certain time?
When is the block released, e.g. after 24h?

I did not run into this limit during developing/testing/using it, so I'm not very keen on implementing evasion techniques, changing the IP address is out of scope at the moment.

from rewe-discounts.

I run this once a week. After 2 months I am facing this issue. Any advice ?

from rewe-discounts.

Strange, I also run it at least once a week for multiple months. I just checked, and the program runs fine.

Can you provide me the error messages or the traceback the program gives you?

from rewe-discounts.

ERROR Expecting value: line 1 column 1 (char 0)

well, it returns a bad response "forbidden 403" which later cannot be parsed as json so it show previous error. And same thing happens when I make this req from an EC2 instance. Any idea why these happen ?

from rewe-discounts.

Please try the new version of the script in the branch fix_403 which mainly includes better error handling to aid debugging and post the error messages.

Right now I think it's a problem on your end as I can't reproduce it. Please double-check that your dependencies like cloudscraper are correctly installed and that the parameters for starting your program don't contain any typos.

from rewe-discounts.

Duplicate of #14, more details there, closing issue.

from rewe-discounts.

@shishir36: Please try the solution in #14, namely pinning the cloudscraper version to 1.2.69. This fixed the issue for at least two people. If it does not work, please re-open #14.

from rewe-discounts.