Description

When restarting a job from a checkpoint file, pagination doesn't work as expected.

The job will continue until the end of the current page, then move to the next page, the first link is be selected before the next content is loaded. This link then falls outside the range and the job terminates early.

Workaround

Add the wait time after goto_next_page function.
This isn't ideal since it relies on a non-zero wait time, it also isn't intuitive behavior for when the wait occurs.

Potential Solutions

• Find an appropriate event to wait in goto_next_page
• Check the first link in each page to make sure it isn't a repeat, try again after a wait if it is