Type:
General step
Generates a unique key for each record, ensuring uniqueness across all datasets. The
Key Generation step generates a 128-bit random number
(UUID), which significantly reduces the likelihood of duplicate
values. This number is designed to be unique across different systems and over time,
allowing for its creation in a decentralized manner.
To enhance the Key Generation process, you can also implement a
deterministic SHA-256 hash, as it ensures that record IDs remain
consistent and repeatable across multiple executions of the pipeline.
Configuration Options
- Step Name: Defines the name for the step. Provide a meaningful name to help anyone editing steps in a pipeline quickly identify the purpose of the step.
-
Properties
-
Key Type: The Generate key step allows you to
create two types of keys for the pipeline:
- UUID (Universally Unique Identifier): Generates globally unique identifiers (UUIDs) for each record, ensuring uniqueness across all datasets.
- Hash: Generates a unique key for records based on selected fields using the SHA-256 Hash algorithm.
- Input Fields: Select a single value or multiple values from the drop-down for which you want to generate a hash key.
- Output Field Name: Assign a unique name to the output field. If a name is not unique, it will result in an error and prevent you from saving the changes.
- You can also Preview your changes and choose to Save or Cancel them.
-
Key Type: The Generate key step allows you to
create two types of keys for the pipeline: