Configure pipeline engines - Precisely Data Integrity Suite

Data Integrity Suite
Product
Spatial_Analytics
Data_Integration
Data_Enrichment
Data_Governance
Precisely_Data_Integrity_Suite
geo_addressing_1
Data_Observability
Data_Quality
dis_core_foundation
Services
Spatial Analytics
Data Integration
Data Enrichment
Data Governance
Geo Addressing
Data Observability
Data Quality
Core Foundation
ft:title
Data Integrity Suite
ft:locale
en-US
PublicationType
pt_product_guide
copyrightfirst
2000
copyrightlast
2026

Pipeline engines provide the computational resources needed to run quality pipelines on supported platforms: Databricks, Google Dataproc, Precisely Agent, and Snowflake. These are essential for running quality pipelines because they allow users to execute data processing and quality checks efficiently. By configuring and managing pipeline engines, you can ensure that your data pipelines run smoothly and meet your specific processing requirements.

Pipeline engines are created and managed from Configuration > Pipeline Engines. Each engine is based on a connection type. When setting up a run configuration for a quality pipeline, you specify which pipeline engine to use for execution.

Create a pipeline engine

  1. On the main navigation menu, select Configuration > Pipeline Engines.
  2. Click the Pipeline Engines tab.
  3. Click + Create Pipeline Engine. The Create New Pipeline Engine settings panel opens.
  4. In the Pipeline engine name field, enter a name for the engine.
  5. In the Type dropdown, select the connection type: Databricks, Google Dataproc, Precisely Agent, or Snowflake.
  6. Configure the options for your selected connection type.
  7. Click Create. The pipeline engine is ready to use in run configurations.

Edit a pipeline engine

  1. On the main navigation menu, select Configuration > Pipeline Engines.
  2. Click the Pipeline Engines tab.
  3. In the Name column, click the ellipsis menu for the engine you want to edit, then click Edit. The Edit Pipeline Engine settings panel opens.
  4. Modify settings as needed.
  5. Click Save.

Delete a pipeline engine

You can only delete an engine that is not currently used in any run configuration.

  1. On the main navigation menu, select Configuration > Pipeline Engines.
  2. Click the Pipeline Engines tab.
  3. In the Name column, click the ellipsis menu for the engine you want to delete, then click Delete.
  4. Click Delete to confirm.