Data Quality - Precisely Data Integrity Suite

Data Integrity Suite Release Notes

Product
Spatial_Analytics
dis_mcp
Data_Integration
Data_Enrichment
Data_Governance
Precisely_Data_Integrity_Suite
geo_addressing_1
platform_spatial_analytics
Data_Observability
Data_Quality
dis_core_foundation
Services
Spatial Analytics
Precisely MCP
Data Integration
Data Enrichment
Data Governance
Geo Addressing
Data Observability
Data Quality
Core Foundation
ft:title
Data Integrity Suite Release Notes
ft:locale
en-US
PublicationType
pt_release_notes
copyrightfirst
2022
copyrightlast
2026

Refer to this topic for information on fixed issues and known limitations associated with Data Quality.

Issue Summary Workaround Noted on
Run parameters with AI Assist in the Custom coding step AI Assist does not support run parameters in the Custom coding step. A script generated by AI Assist does not declare run parameter tokens, so the Select properties to map panel shows no properties for the step. Declare each token manually in the script in the @{name:default} format, then map it to a run parameter with the same name as the token. For more information, see Configure run parameters for quality pipelines. November 2026
Cross-environment run configurations with Databricks target datasets When a Databricks target dataset is selected in a cross-environment run configuration that uses an agent-based pipeline engine, cluster-based cross-connection configurations can perform very slowly. Recommended: Use SQL Warehouse when a Databricks target dataset is selected. September 2026
Limitations for the Candidate Finder operator
  • Unsupported reference dataset sources: Candidate Finder does not support Amazon S3 or Azure Data Lake Storage (Gen2) as reference dataset sources. Pipelines configured with Amazon S3 or Azure Data Lake Storage (Gen2) reference datasets for Candidate Finder will not be executed.
  • Pipeline as a Service on Agent: Candidate Finder is out of scope for running Pipeline as a Service on Agent.
  • Real-time service in Databricks: For real-time service execution in Databricks, the reference dataset must be sourced from a Databricks SQL Warehouse or Databricks-managed dataset.
  • Runtime behavior for partition-based processing : In runtime environments, such as Databricks or Spark execution:
    • Candidate Finder processes data in a distributed manner based on partitions.
    • Candidate group numbers are assigned independently within each partition.

As a result, ordering or grouping may vary depending on partitioning strategy and data distribution.

NA September 2026
SQL rule queries with duplicate output column names When failed-record capture or output is turned on for an SQL rule, a query that returns more than one output column with the same name, including names that differ only by case, can treat the columns as ambiguous and can fail. If failed-record capture and output are turned off, the rule run can complete. This can occur when a query selects fields with the same name from joined datasets.

Assign aliases so each selected output column has a unique name.

Instead of:

SELECT a3.Name, a.Name FROM hive_metastore.basicprofiling.alldatatypes3 a3 LEFT JOIN hive_metastore.basicprofiling.alldatatypes a ON a3.Id = a.Id WHERE a3.IsActive = true

Use:

SELECT a3.Name AS Name3, a.Name FROM hive_metastore.basicprofiling.alldatatypes3 a3 LEFT JOIN hive_metastore.basicprofiling.alldatatypes a ON a3.Id = a.Id WHERE a3.IsActive = true
September 2026
Snowflake NUMBER(38,2) Columns May Lose Decimal Precision

When a Snowflake NUMBER(38,2) column is cataloged in Data Integrity Suite, it may be interpreted as an Integer. As a result, the pipeline may store the column as BIGINT or NUMBER(38,0), causing the decimal portion of the value to be lost.

This is an existing product limitation and is not related to the recent data type mapping update.

  1. Open the affected transformation step and select Edit.
  2. Select a different column.
  3. Select Save.
  4. Re-select the original column.
  5. Select Save again.
Refreshing the column selection forces the pipeline to reload the latest metadata and restores the correct data type mapping.
August 2026
Verify and Geocode operator across different DBR versions The Verify and Geocode operator is not supported across different DBR versions when the pool type is arm type. NA August 2026
Multi-level matching issue on Snowflake runtime The Create unified match groups across rules option does not work with the Multi-Level Matching with Transitive Grouping (Inter and Intra Flow) step on the Snowflake runtime environment. For more information, see Snowflake support case. NA July 2026
Custom data quality rule evaluation with CSV files When evaluating custom data quality rules using assets stored in CSV files within the Amazon S3 datasource, the process tends to take longer compared to working with other file formats such as Parquet or JSON. This delay occurs because, during the rule evaluation, all fields in the dataset are read from the CSV file, rather than selectively accessing only the required fields. NA February 2026
Geolocation API source preview fails with "NullPointerException" When you attempt to preview a transformation step that uses the Geolocation Address API source in a data quality pipeline, the preview operation fails. This limitation affects only the preview functionality in the transformation step editor. NA December 2025
Step preview row limit in Data Quality pipelines The Step Preview feature supports a maximum of 500 rows in total, distributed across all input sources for an operator. For example, if a step has two input datasets, only 250 rows from each will be included in the preview. This may result in incomplete previews when working with larger datasets. For Upload File sources used in sample generation, ensure that the most relevant records are positioned at the top of the file. June 2025
Quality score generation with profiling When configuring a datasource with Profile Datasets toggle enabled and the Run Quality Rules and Calculate Scores toggle disabled it is noticed that a quality score is generated for certain datasets, providing additional insights beyond the expected behavior. NA March 2025
Data-type limitation in quality rules The 'Time' datatype is not supported when setting up Catalog rules for Dataproc or BigQuery connections. It defaults to 'String', which may affect rule accuracy. Currently, there is no direct workaround. To ensure accurate rule evaluation when using Dataproc or BigQuery connections, consider using alternative data-types. December 2024
Agent selection impact If no agent is selected, the Insights feature will be disabled due to the absence of agent selection. This means that in order to enable the Insights feature, an agent must be actively chosen. NA November 2024