Manage continuous replication pipeline - Precisely Data Integrity Suite

Start replication pipelines

When you stop a project to perform maintenance, you can manually restart it.

To start all pipelines in a project:

1. On the main navigation menu, click Integration > Continuous Replication tab.
2. Select the project that contains the pipelines you want to start.
3. Select the check box to select all pipelines, then click the Start selected pipelines icon. The Start Replication Pipeline window opens.
4. Do one of the following:
   • Click Start to start the pipelines. If there are no errors, the window closes and statuses show as OK. If there are problems, an error message displays.
   • Click Cancel to close without starting.
5. For Copy and Replicate pipeline types, choose one of the following dataset options before replication begins:
   • Do not copy datasets: No datasets are copied.
   • Copy all datasets: All available datasets are copied before replication starts.
   • Select datasets to copy: Choose specific datasets to copy before replication.

To start a single pipeline:

1. On the main navigation menu, click Integration > Continuous Replication tab.
2. Select the project that contains the pipeline.
3. Click the three ellipses next to the pipeline, then select Start from the dropdown menu. The start replication pipeline window opens.
4. Click Start to start the pipeline, or Cancel to close without starting.

To start the log reader with sequence number control:

1. On the main navigation menu, click Integration > Continuous Replication tab.
2. Select the project, then select the pipelines you want to start.
3. Click the ellipses icon on the global menu, then click Start Log Reader. The window displays pipeline details and log reader information.
4. Select the sequence number option:
   • Select Resume from the last read (Warm), or
   • Select Specify and choose values for Journal Receiver and Sequence Number from the dropdowns (defaults: Currently Attached and Last in Receiver).
5. Click Start to start the pipelines, or Cancel to close without starting.

Stop replication pipelines

After you start a pipeline, you can manually stop it at any time.

To stop all pipelines in a project:

1. On the main navigation menu, click Integration > Continuous Replication tab.
2. Select the project that contains the pipelines you want to stop.
3. Select the check box to select all pipelines, then click the Stop selected pipelines icon. The Stop Replication Pipeline window opens.
4. Click Stop to stop the pipelines, or Cancel to close without stopping.

To stop a single pipeline:

1. On the main navigation menu, click Integration > Continuous Replication tab.
2. Select the project that contains the pipeline.
3. Click the three ellipses next to the pipeline, then select Stop from the dropdown menu. The stop replication pipeline window opens.
4. Click Stop to stop the pipeline, or Cancel to close without stopping.

To stop the log reader:

1. On the main navigation menu, click Integration > Continuous Replication tab.
2. Select the project, then select the pipelines you want to stop.
3. Click the ellipses icon on the global menu, then click Stop Log Reader. The window displays pipeline details and log reader information.
4. Click Stop to halt the pipelines. Statuses change to Stopped. Click Cancel to close without stopping.

View pipeline details

You can view the status, backlog, versions, and metrics of a pipeline.

1. On the main navigation menu, click Integration > Continuous Replication tab.
2. Select the project that contains the pipeline.
3. Click the pipeline name, or click the three ellipses next to the pipeline and select Details. The pipeline details window opens.

The Overview section provides:

• Description: Purpose of the pipeline.
• Project: Project the pipeline belongs to.
• Type: Replication method.
• Last Refreshed: When the project was last refreshed.
• Current phase: Current phase of the pipeline.
• Engine Processes: Status of processes on all runtime servers.
• Replication: Status of replication processes.
• Capture: Status of table capturing across all data connections.
• Log Reader: Overall status of the log reader component.

The Health section provides:

• Replication Engine
  • Engine Processes: Operational health of processes on all runtime servers.
  • Replication: Status of replication processes across all runtime servers.
  • Staged version: Snapshot of data prepared for replication but not yet applied to the target.
  • Active Version: Current live state of the data being accessed.
• Log Reader
  • Log reader: Overall status of the log reader component.
  • Journal receiver library/Name: Library storing journal receivers that capture data changes.
  • Current sequence number: Latest sequence number for tracking change order.
• Connections
  • Source
    • Type: Type of source system (for example, Oracle, Db2 for IBMi).
    • Replication engine: Engine managing replication from the source.
    • Capture: How data changes are detected and recorded at the source.
    • Log reader: Log reader component for the source.
  • Target
    • Type: Type of target system (for example, Kafka).
    • Replication engine: Engine managing replication to the target.

The Backlog and Latency section provides:

• Backlog
  • Backlog rows: Number of rows pending replication.
  • Clear Backlog: Action button to clear backlog data.
• Latency
  • Current Latency: Time delay between data capture and replication, broken down by Capture, Replication, and Total.
  • Average Latency: Average latency over a period, broken down by Capture, Replication, and Total.
  • Static estimation window: Duration over which latency is averaged.
• Replicated Data
  • Pipeline started: Date and time the current pipeline began.
  • Captured (Source): Rows, Bytes, Transactions, and Skipped rows captured from the source.
  • Sent (Source): Rows, Bytes, Transactions, and Skipped rows sent from the source.
  • Applied (Target): Rows, Bytes, and Transactions applied to the target.

Edit replication pipeline

1. On the main navigation menu, click Integration > Continuous Replication tab.
2. Select the project that contains the pipeline you want to edit.
3. Click the three ellipses next to the pipeline, then select Edit. The edit pipeline wizard opens.
4. Modify the steps as needed, then click Save.

Manage capture for a replication pipeline

1. On the main navigation menu, click Integration > Continuous Replication tab.
2. Select the project that contains the pipeline.
3. Click the three ellipses next to the pipeline, then select Capture. The Capture window opens.
4. Select the tables for which you want to enable capture, then click Make Changes.

Clear backlog for a replication pipeline

1. On the main navigation menu, click Integration > Continuous Replication tab.
2. Select the project that contains the pipeline, then navigate to the pipeline details and click Clear Backlog.

Delete replication pipeline

1. On the main navigation menu, click Integration > Continuous Replication tab.
2. Select the project that contains the pipeline you want to delete.
3. Click the three ellipses next to the pipeline, then select Delete. The delete pipeline window opens.
4. Confirm the pipeline details, then click Delete to delete, or Cancel to discard.