Crawler operations

Source scheduling, renderer type, rate limits, and recent BullMQ crawl persistence state.

Jobs API
Sources
Configured marketplaces
5
Persistence
Postgres crawl-job access
Connected
Latest jobs
Stored crawl runs
12

Source registry

SourceRendererCountriesScheduleRate
AutoScout24cheerioDE, AT, BE, FR, NL*/30 * * * *20/min
mobile.decheerioDE*/30 * * * *18/min
CarvagocheerioCZ, DE, FR, IT, NL0 * * * *15/min
KleinanzeigencheerioDE15 * * * *12/min
GoCarcheerioCZ, SK45 * * * *45/min

Recent jobs

Inspect JSON
SourceStatusFoundSavedStarted
carvagoFAILED002026-08-26T08:38:00.301Z
gocarFAILED002026-08-26T08:37:52.054Z
carvagoFAILED002026-08-26T08:37:48.735Z
mobile-deFAILED002026-08-26T08:37:45.515Z
gocarFAILED002026-08-26T08:37:44.483Z
carvagoFAILED002026-08-26T08:37:37.667Z
mobile-deFAILED002026-08-26T08:37:36.829Z
gocarFAILED002026-08-26T08:37:36.760Z
carvagoFAILED002026-08-26T08:37:36.660Z
mobile-deFAILED002026-08-26T08:37:31.390Z
gocarFAILED002026-08-26T08:37:31.330Z
mobile-deFAILED002026-08-26T08:37:30.929Z