[SOLVED] Cron expression for Databricks schedule job

Issue

I need to schedule a job in databricks that should run at 6am, 6.15, 6.30, 6.45, 7, 7.15, 7.30, 7.45 and 8am every day.

I am using below expression however it is not running at 8am. Is there anyway we can achieve this?

0 0,15,30,45 06,07 ? * *

Solution

This is expected behaviour from cron expression. As per your requirement, you need to write separate cron expression for the 08:00 as follows:

Note that some scheduling requirements are too complicated to express with a single trigger - such as “every 5 minutes between 9:00 am and 10:00 am, and every 20 minutes between 1:00 pm and 10:00 pm”. The solution in this scenario is to simply create two triggers, and register both of them to run the same job.

This will run from 6.00 until 7.45, every 15 minutes:

* 0/15    06-07       *     *   *   

If you want it to run until 08:00 then you have to create two triggers and register both if them to run the same job.

* 0/15    06-07      *     *    *     
*  0       08        *     *    *    

Reference: Databricks uses Quartz Cron triggers. Databricks – Cron Triggers

Hope this helps.

Answered By - CHEEKATLAPRADEEP-MSFT