Scheduler

Number of Schedule regarding your plan
FREE DISCOVERY PRO STARTUP ENTERPRISE
1 schedules 5 schedules 100 schedules 200 schedules 500 schedules

Scheduler is a feature that allows you to execute periodic task (async scrape or Spider execution).

The periodicity is express in a well known cron format. You can also refer to crontab.guru for more pratical usage.

See in Your Dashboard

Schedule Scrape

You can schedule Scrape from the API Player via Create Schedule button. It will automatically load the current configuration into the schedule.

Schedule Spider

Spider feature is not publicly available yet

Monitoring

While creating a Schedule you can set tags to easily filter in monitoring.

To visualize scrape triggered by schedule, you can filter on origin field in monitoring section.

origin:scheduler

Summary