Cannot use multiple 'PlaywrightCrawlers' simultaneously about crawlee HOT 1 CLOSED

This might be caused by both crawlers sharing the same storage. You can tell Crawlee to use different storage backends with each crawler by supplying the optional second constructor parameter.

const crawler = new CheerioCrawler(
      {
          ...crawlerOptions
      }, 
+    new Configuration({
+       persistStorage: false,
+    })
);

In the Configuration, you can:

• Either set up an memory-only crawl (by using persistStorage: false - this also causes the crawlers to not share the storage, as each crawler now uses a separate in-memory storage backend).
• Use storageClientOptions.localDataDirectory to tell each crawler to save data to its own directory.
• Use different default(Dataset|KeyValueStore|RequestQueue)Id options to tell each crawler to store its data in separate datasets / KVS / request queue.

Let us know whether this helped. Cheers!

from crawlee.