Once a datasource has been added, you can view its details, edit its name and description, or remove it. You can also manage its connections by finding, testing, editing, duplicating, removing connections, and configuring insights and schedules.
Go to Configuration > Datasources in the main navigation menu. To manage connections for a specific datasource, select the datasource from the list.
Datasource and connection permissions
The actions available for datasources and connections depend on your assigned permissions. These permissions are action-based, so view access does not automatically include create, update, delete, or operate access.
| Permission | Allows |
|---|---|
| View | View or list datasource and connection information. |
| Create | Create datasources and connections. |
| Update | Modify datasource and connection configuration. |
| Delete | Remove datasources and connections. |
| Operate | Run operational functions for datasource and connection functionality, including connection testing and discovery operations. |
View details for a datasource
Required permission: View.
- Open the context menu next to a datasource name and select Details.
-
The datasource details page opens and shows:
- Datasource type: The type of database the datasource connects to, such as MSSQL or Oracle.
- Description: A brief summary of the datasource's purpose or data type.
- Connections, Datasets, Fields: Counts of associated connections, datasets, and fields.
- A list of all connections associated with the datasource, including each connection's catalog status, dataset and field counts, host or URL, and schedule.
Edit a datasource
Required permission: Update.
- Select the datasource name to open its connections page.
-
Select
Edit Details
to edit the name and description.
What's changed: In the new user experience, Edit Details appears as Edit. For more information on the new experience, see About the new user experience.
- Select Save.
Remove a datasource
Required permission: Delete.
- Open the context menu next to the datasource name and select Remove.
- In the confirmation dialog, select the checkbox to confirm and choose Remove, or choose Cancel to exit.
- Removal cannot be undone. All in-progress data discovery will stop.
- Removing a datasource connection does not delete related assets or data quality pipelines. Associated assets remain in the catalog; pipelines are unaffected.
- To remove all associated assets, delete the datasource. Data quality pipelines are not automatically deleted and must be removed manually if no longer needed.
Manage connections
The actions below allows you to handle your connections to various datasources effectively.
Find a connection
Required permission: View.
- Select the datasource whose connections you want to search.
- Type the connection name in the Search bar above the Connections list, or scroll through the list to locate it.
Test a connection
During connection creation:
- In the Add Datasource wizard, complete all required connection fields.
-
Select
Test
. A
Success
message appears if the connection is valid.
What's changed: In the new user experience, Test appears as Test Connection. For more information on the new experience, see About the new user experience.
- Select Next to continue.
For an existing connection:
- Find the connection you want to test.
-
Open the context menu next to the connection name and select
Test
.
What's changed: In the new user experience, Test appears as Test Connection. For more information on the new experience, see About the new user experience.
- A Success message appears if the test passes.
You can save a connection without testing it, or save one that fails a test and resolve issues later.
Common reasons for test failure:
- The connection does not have access to the server or database due to network security rules.
- Data Integrity Suite is unable to reach the datasource host machine.
- Credentials are invalid or do not provide the necessary access permissions.
- The database or data warehouse is offline.
View connection details
Required permission: View.
- Find the connection you want to view.
- Select the connection name. A side panel opens on the right displaying the following details:
| Field | Description |
|---|---|
| Description | Details about the datasource. |
| Catalog Summary | Overall discovery status for the connection. |
| Last Completed | Timestamp of when discovery last completed. |
| Datasets | Number of datasets associated with the connection. |
| Fields | Number of fields associated with the connection. |
| Options | Fields configured when the connection was added. |
View or add data assets
View data assets
Required permission: View.
- Find the connection you want to manage data assets for.
- Open the connection, then select the Data assets page to view the selected datasets.
Add or change data assets
Required permission: Update.
- Find the connection whose configured data assets you want to change.
- Open the connection, then select the Data assets page.
- To add more datasets, select Edit, choose the checkboxes for the datasets you want to add, then select Save. Discovery starts automatically for the newly selected assets.
Edit a connection
Required permission: Update.
- Find the connection you want to edit.
- Open the connection, then select Edit Details.
- Modify the connection properties on the Edit connection page.
- Optionally, select Test to verify the connection.
- Select Next to save your changes.
Duplicate a connection
Required permission: Create.
Duplicate an existing connection to reuse its configuration. After duplicating, you can edit any settings.
- Find the connection you want to duplicate.
- Open the context menu next to the connection name and select Duplicate.
-
On the
Duplicate Connection
page, provide a new name.
Note: You must enter authentication credentials for the duplicate connection to test or save it.
- Optionally, select Test to verify the connection.
- Select Next to save the duplicate.
Remove a connection
Required permission: Delete.
- Deletion cannot be undone.
- Connection information remains in the catalog after removal but will no longer be updated during discovery. Update any configuration that depends on the removed connection.
- Find the connection you want to remove.
- Open the context menu next to the connection name and select Remove.
- In the confirmation dialog, select the checkbox to confirm and choose Remove, or choose Cancel to exit.
If the connection is in use by one or more replication pipelines, an error message indicates it cannot be removed.
View insights
Required permissions: You need View permission to view connection insights. You need Update permission to modify insight settings.
- Find the connection you want to view insights for.
-
Open the connection, then select the
Insights
page. The page displays:
- Pipeline Engine: The engine used for the selected connection.
- Profile datasets: Toggle on to profile your data, capturing statistics, distributions, and semantic types. Update permission is required to change this setting.
| Number of columns | Executor memory |
|---|---|
| 50 | 2 GB |
| 100 | 3 GB |
| 150 | 5 GB |
View and edit schedule
Required permissions: You need View permission to view a connection schedule and Update permission to modify an existing schedule.
- Find the connection whose schedule you want to view or edit.
-
Open the connection, then select the
Schedule
page. The page shows:
- Occurrence: The scheduler frequency (daily, weekly, or monthly).
- Schedule Summary: A summary of the configured schedule.
- If you have Update permission, select Edit Schedule to open the side panel, adjust the settings, then select Save.