Split ingest process about numbersearch HOT 4 CLOSED

I propose that we scrape BulkVS every hour and FirstCom and Tele every 12 hours.

from numbersearch.

Sounds good, lets ensure BulkVS numbers are invalidated hourly too!

from numbersearch.

@danry25 I have split up the cycles on the ingest process in 9a0d338. BulkVS will run every hour, TeleMessage and FirstCom will run every 12 hours. Because numbers are invalidated in bulk, I have set all numbers to be invalidated if the have not been re-ingested in the last 12 hours as that's the slowest cycle time. This build has been pushed to prod. Please update the cron job to run every 30 minutes. This is double the minimum cycle time, so we would expect it to do nothing on every other run.

from numbersearch.

This cronjob has been set to run at 11 minutes and 41 minutes past the hour respectively.

from numbersearch.