Scenario: It is observed that a data drift alert is triggered under specific conditions, even when the change in data percentage is significantly below the established threshold.
Threshold set to generate alerts: Change in the data properties by 5%.
Example: Consider a database that has a cardinality value of 50. Let’s assume that the cardinality number remains constant for a certain duration and increases by 4% over a period of few days, and the new cardinality value changes to 52. With this condition, an alert would not be generated as the difference in the value is within the set threshold limit.
Alert: Consider a scenario in which a value has been consistently increasing by 4% each day. Suppose the cardinality reaches 55 and subsequently decreases to 54 on the following day. Although this decrease is less than 1% - below the established alert threshold, an alert is generated due to the shift in trend from an upward to a downward direction. This example illustrates cases where alerts are triggered outside of set thresholds whenever there is a reversal in the direction of the data trend.