Configure a Snowflake pipeline engine - Precisely Data Integrity Suite

Data Integrity Suite
Product
Spatial_Analytics
Data_Integration
Data_Enrichment
Data_Governance
Precisely_Data_Integrity_Suite
geo_addressing_1
Data_Observability
Data_Quality
dis_core_foundation
Services
Spatial Analytics
Data Integration
Data Enrichment
Data Governance
Geo Addressing
Data Observability
Data Quality
Core Foundation
ft:title
Data Integrity Suite
ft:locale
en-US
PublicationType
pt_product_guide
copyrightfirst
2000
copyrightlast
2026

Configure a Snowflake pipeline engine to run quality pipelines on your Snowflake environment. You can customize schema settings, query timeouts, and optional enrichment databases.

When you configure a Snowflake pipeline engine, you specify the connection, schema, and optional query timeout and enrichment database settings.

  1. In the Pipeline engine name field, enter a meaningful name for the pipeline engine.
  2. Verify that Type is set to Snowflake.
  3. In the Connection dropdown, select the Snowflake connection for the environment you want to use.
  4. In the Schema dropdown, select a schema within the Snowflake datasource where the pipeline engine has write permissions.
    This schema is used by the pipeline engine for reading and writing temporary staging data during processing, not just for accessing the data to be processed.
  5. Optional: In the Session query timeout in seconds field, specify the Snowflake query timeout at the session level.
    This sets the maximum amount of time a query can run before it is automatically stopped. Session-level Snowflake query timeout has the highest precedence among User, Warehouse, and Account levels, so if a lower-level timeout query is being used, the session-level query will override it.
  6. Optional: In the Enrich datasets database field, enter the name of the data share database in the Snowflake environment.
    Use the exact data share database name to access these datasets while running a pipeline with the Enrich step. This provides improved flexibility and customization for saving the data share under one name.
  7. Click Create or Save.
    The Snowflake pipeline engine is configured and ready to use in run configurations.

Set up the Enrich datasets database for Snowflake

To use the optional Enrich datasets database feature, follow these steps:

Note:
  • To subscribe to data or create data shares in the Precisely workspace, contact your Precisely support representative.
  • Depending on the subscribed platform, customers can send an email to the Databricks Partnership or Snowflake Partnership to provision subscribed data.
  • For more information about viewing data shares in the Snowflake environment, see Data Consumers in the Snowflake documentation.
  1. Set up data share: Ensure you have set up a data share that contains the datasets you intend to use for data enrichment. This share should include all the relevant datasets required for the Enrich step.
  2. Create database from a data share: For first-time users, it's crucial to create a database from the data share within your workspace. Go to Data > Private Sharing > Shared With You and locate the data share containing the enrich datasets. Select Get Data associated with the data share. This creates a database that includes the share within your workspace, making it accessible for future enrichment steps.
  3. Name your data share: While creating a database, provide a name for the database. This name helps you identify the specific dataset collection associated with the Enrich step.
  4. Access the database: Once the data share database is created, you can access the datasets within your workspace's Data > Databases section. The datasets are organized under the database name you provided.
Related information