After you complete the datasource and connection configuration wizard and click Save, the Data Integrity Suite automatically initiates a multi-stage configuration workflow. This workflow performs essential setup operations and begins cataloging your data assets. Status indicators on the datasource configuration panel provide real-time visibility into the progress of each operation.
Configuration workflow overview
The datasource configuration workflow consists of the following sequential operations:
- Adding metamodel: The system prepares the data model structure required to represent your datasource metadata.
- Creating datasource: The datasource is formally created and registered in the system.
- Create connection: The connection to your datasource is established and validated.
- Configure profiling and quality: If enabled during setup, the system configures profiling and data quality rule execution.
- Create or resume pipeline engine: The system creates or resumes the pipeline engine required for profiling and quality rule execution.
- Initiating discovery: The system begins cataloging your data assets and metadata.
Each operation is tracked with a status indicator that updates in real-time as the workflow progresses. You can monitor the configuration progress by going to Configuration > Datasources and selecting your datasource. A configuration panel appears on the right side of the screen, displaying the status of each operation.
Status indicators
The configuration panel displays status indicators for each operation in the workflow. The following table describes each status indicator:
| Status | Icon | Description |
|---|---|---|
| In Progress | Spinner (rotating circle) | The operation is currently running. The system is actively processing this step. |
| Completed | Green checkmark | The operation has completed successfully. All configuration steps for this operation are finished. |
| Failed | Red error icon | The operation encountered an error and did not complete. Click the status indicator to view error details and troubleshooting information. |
| Warning | Orange or yellow warning icon | The operation completed with warnings or requires manual intervention. Click to review details. |
| Not discovered | Empty circle | The discovery process has not yet been initiated or completed for this datasource. |
Datasource configuration failures
If an operation fails during the datasource configuration workflow, a Failed error indicator is displayed next to the datasource name in the Datasources list. To view failure details, select the datasource. The configuration panel opens and displays the operation-level status along with the associated error message and diagnostic information. After resolving the underlying issue, you can retry the failed operation without restarting the entire datasource configuration process.
For example, if the Create connection operation fails due to incorrect credentials, update the connection details with valid credentials and retry the operation.
If a failure occurs after the discovery process has completed, go to Connection > Datasets and review the associated error logs to determine the root cause.
Retry behavior
If an operation fails, you can retry it from the point of failure. The workflow resumes from the failed step, and previously completed steps are not run again unless required. Status indicators update in real time while the retry is in progress. Each operation can be retried up to three times. After the third failed attempt, the Data Integrity Suite does not allow additional retries and may require manual correction or reconfiguration before proceeding.
For step-by-step instructions on configuring datasources and connections, refer: