In this step, you establish connections to the source and target systems. These connections are the backbone of the data transfer process, allowing the pipeline to retrieve data from the source and apply it to the target. Proper configuration of these connections is vital for seamless data flow.
- Add at least one data connection for each type of data source and target database, file system, or Kafka streaming service you plan to connect to. When a data connection is created, the runtime server is selected from the list.
- Add pipelines and associate each pipeline in a project to a source data connection and a target data connection.
- Run or start your Data Integration project, which contains a collection of pipelines that are processed against tables in your data set.
Use data connections to access both data source and target systems. Connections configured to access Kafka are only valid for these targets and cannot be used to connect to data sources.