Crawler operations

Source scheduling, renderer type, rate limits, and recent BullMQ crawl persistence state.

Jobs API
Sources
Configured marketplaces
5
Persistence
Postgres crawl-job access
Connected
Latest jobs
Stored crawl runs
12

Source registry

SourceRendererCountriesScheduleRate
AutoScout24cheerioDE, AT, BE, FR, NL*/30 * * * *20/min
mobile.decheerioDE*/30 * * * *18/min
CarvagocheerioCZ, DE, FR, IT, NL0 * * * *15/min
KleinanzeigencheerioDE15 * * * *12/min
GoCarcheerioCZ, SK45 * * * *45/min

Recent jobs

Inspect JSON
SourceStatusFoundSavedStarted
carvagoFAILED002026-10-24T11:05:45.570Z
kleinanzeigenFAILED002026-10-24T11:05:36.827Z
gocarFAILED002026-10-24T11:05:35.316Z
mobile-deFAILED002026-10-24T11:05:29.486Z
carvagoFAILED002026-10-24T11:05:17.026Z
carvagoFAILED002026-10-24T11:04:58.512Z
gocarFAILED002026-10-24T11:04:58.440Z
kleinanzeigenFAILED002026-10-24T11:04:55.619Z
carvagoFAILED002026-10-24T11:04:53.105Z
mobile-deFAILED002026-10-24T11:04:48.472Z
gocarFAILED002026-10-24T11:04:48.372Z
kleinanzeigenFAILED002026-10-24T11:04:48.272Z