Configure row filters and define conditions

Data Integrity Suite

Product
Spatial_Analytics
Data_Integration
Data_Enrichment
Data_Governance
Precisely_Data_Integrity_Suite
geo_addressing_1
Data_Observability
Data_Quality
dis_core_foundation
Services
Spatial Analytics
Data Integration
Data Enrichment
Data Governance
Geo Addressing
Data Observability
Data Quality
Core Foundation
ft:title
Data Integrity Suite
ft:locale
en-US
PublicationType
pt_product_guide
copyrightfirst
2000
copyrightlast
2025

The integration of conditional rules with specific data filtering capabilities aims to enhance the precision and efficiency of data processing systems. This feature allows rules to be applied selectively to datasets and fields, thereby providing more relevant and actionable insights. With this enhancement, a new step will be added to the rule creation process allowing users to define a row filter. This filter acts similarly to a where clause, specifying which rows of data should be evaluated by the rule.

You can choose to evaluate the row filters based on basic and advanced conditions.

  • Basic conditions can be used for simple evaluation scenarios. You can configure a basic condition by selecting the value and the associated operator. The initial value field acts as an alias for all the target fields. Any condition configured in the Basic tab is converted into an expression in the advanced tab.
    • Select the combination of <attribute><operator><enter value><value> and type a value that should match the condition.
    • Select the combination of <attribute><operator><select field > <field> and select a field that should match the condition. In this case, you can compare the selected field with the field of the same data type. You can use this for all available data types.
  • Advanced conditions can be used for more complex evaluation scenarios. Within the Advanced tab, you can configure an expression using numerical, string and logical operators.
    To configure row filters for rule evaluation:
    1. Click Add Evaluated Rows Filter.
    2. Choose to evaluate the rows using basic or advanced conditions.
    3. Click Add filter to add more conditions to the row filter and select between Match All (logical AND) or Match Any conditions (logical OR).
    4. Once the rows are filtered, apply pass conditions for the filtered data assets.
    5. Save the rule and initiate the run.
    Note: All the fields added from the evaluated row filter have to be mapped to the reference dataset or field.

Auto generate expression for row filters using natural language

The expression for advanced conditions in the row filters can be generated using the AI assist option.

  1. In the Evaluate row filters section, click AI assist.
  2. In the description box, enter your logic in plain English. Ensure the details of the relevant datasets or fields are added to the logic.
  3. Click Generate. The application will generate an expression for the row filter based on the inputs.
  4. Click Apply to save the changes and filter only those rows that satisfy the condition.

For more information on generating these expressions, refer to Auto generate rule expression for pass conditions using AI.