Create custom semantic types - Precisely Data Integrity Suite

Custom semantic types define how your system classifies and matches data patterns. You can create semantic types based on regular expressions or predefined lists of values.

1. Go to Configuration > Catalog > Semantic Types.
2. Click Create Semantic Type.
3. In the Create Semantic Type dialog, enter the following information:
   • Name: A descriptive name for the semantic type (for example, "Customer ID" or "Product SKU").
   • Qualifier: A unique identifier for the semantic type using uppercase letters and underscores (for example, "CUSTOMER_ID" or "PRODUCT_SKU").
     Warning: This qualifier is immutable and cannot be changed after the semantic type is saved.
   • Description (optional): Detailed description of what this semantic type represents and when it should be applied.
   • Threshold: Enter the percentage of valid values (0-100) required for the semantic type to be applied to a field. For example, a threshold of 95 means 95% of the field values must match the criteria.
   • Priority: Assign a priority number that determines the evaluation order during data profiling. Lower numbers indicate higher priority (1 is the highest priority).
   • Base data type: Select the data type that this semantic type applies to. Options include Boolean, Number (Double), Number (Long), String, Local Date, Local Time, Local Date Time, Offset Date Time, and Zoned Date Time.
4. Configure the Asset Match Criteria section:
   • Match type: Select either Regex pattern or List of values to define how the semantic type matches data.
   • For Regex pattern: Enter a regular expression in the Data value regex field that matches your data values and click the Test button to validate your pattern.
   • For Regex pattern (optional): Enter a regular expression in the Header regex field to match column names or headers.
     • Use the Test a value input field.
     • Click the Test button to validate your pattern.
   • For numeric base types (optional): You can specify a Value range with minimum and maximum values to further refine the matching criteria.
   • For List of values: Select this option to match against a predefined list of valid values instead of a regex pattern.
     • Enter each value in the Values field and click the + button to add it to the list.
     • Each added value appears as a removable tag. You can remove any value by clicking the X button on its tag.
     Note: The system validates that each value matches the selected base data type and displays an error message if it does not. During semantic type detection, value matching is case-insensitive.
5. Click Create Semantic Type to save your custom semantic type.
   Your semantic type is now available for use in your workspace and can be applied to fields during profiling operations.