The Schedules tab in the Data Integrity Suite allows users to automate pipeline job execution by setting schedules, defining run frequency, and managing schedule status. You can view and manage pipeline schedules, including editing, enabling/disabling, or deleting them, to enhance data processing and integrity checks.
The Schedules tab allows you to automate the execution of pipeline jobs, enhancing the data quality experience within the Data Integrity Suite. This feature enables you to:
- Schedule a pipeline job run: Automate the execution of pipeline jobs by setting up schedules.
- Define the frequency: Specify how often the pipeline should be run, ensuring timely data processing and integrity checks.
Using the schedules tab
In the Schedules tab, you can perform the following actions:
- View the list of pipelines: See all available pipelines along with their respective run configurations.
- Check the frequency and timing: Under the Schedule column, view the frequency and timing of each scheduled pipeline.
- See the Schedule Status: Determine whether each pipeline's schedule is enabled or disabled.
-
Access additional options: Use the contextual menu for each pipeline to:
- Edit Schedule: Modify the existing schedule for a pipeline.
- Enable/Disable Schedule: Toggle the schedule status for a pipeline.
- Delete Schedule: Remove the schedule for a pipeline.
Schedules list page
On this page, you can schedule a pipeline. The table on this page lists pipelines that are ready for scheduling along with their run configuration, schedule, and status. This page is displayed when you navigate to tab on the main navigation menu. Features of the Schedules List Page:
-
Search: User has to search with Run Configuration name to filter the list and show only matching schedules.
-
Configure Schedule: Click this button to configure a new schedule.
-
Pipeline: Shows the name of a pipeline.
-
Run Configuration: Shows the name of the run configuration applied. Click the ellipsis to edit, disable, or delete a schedule.
-
Schedule: Shows the details of the schedule applied to the pipeline. You can edit the schedule by clicking on Edit Schedule.
-
Schedule Status: Indicates whether a schedule is enabled or disabled.
Create a schedule
-
When a pipeline is invalid, an invalid icon is displayed beside the pipeline name. You cannot create a schedule. Please resolve the pipeline issue before trying to schedule it.
-
If the run configuration is not valid, you cannot create a schedule. Please resolve the run configuration issue before attempting to schedule it.
You can easily configure a schedule in three steps:
-
Click on the Configure Schedule button.
-
Select the pipeline for which you want to create a schedule and click on the Next button.
-
Follow a method to configure the schedule. For more information, refer to Creating and Managing Schedules.