Crawler operations

Source scheduling, renderer type, rate limits, and recent BullMQ crawl persistence state.

Jobs API
Sources
Configured marketplaces
5
Persistence
Postgres crawl-job access
Connected
Latest jobs
Stored crawl runs
12

Source registry

SourceRendererCountriesScheduleRate
AutoScout24cheerioDE, AT, BE, FR, NL*/30 * * * *20/min
mobile.decheerioDE*/30 * * * *18/min
CarvagocheerioCZ, DE, FR, IT, NL0 * * * *15/min
KleinanzeigencheerioDE15 * * * *12/min
GoCarcheerioCZ, SK45 * * * *45/min

Recent jobs

Inspect JSON
SourceStatusFoundSavedStarted
kleinanzeigenRUNNING002026-06-27T11:18:02.056Z
carvagoRUNNING002026-06-27T11:18:00.665Z
mobile-deFAILED002026-06-27T11:18:00.623Z
autoscout24COMPLETED18182026-06-27T11:17:58.878Z
gocarFAILED002026-06-27T11:17:58.821Z
mobile-deFAILED002026-06-27T11:17:58.761Z
carvagoFAILED002026-06-27T11:17:56.404Z
gocarFAILED002026-06-27T11:17:56.315Z
kleinanzeigenCOMPLETED78782026-06-27T11:17:55.119Z
carvagoFAILED002026-06-27T11:17:54.287Z
mobile-deFAILED002026-06-27T11:17:54.236Z
autoscout24COMPLETED19192026-06-27T11:17:53.638Z