Monitoring Pipeline Performance

Performance monitoring helps you ensure your pipelines are running efficiently and reliably. The Performance Dashboard tracks metrics across your pipelines to help identify bottlenecks and optimize workflows.

---

Accessing Performance Metrics

1. Open a pipeline from the Pipelines Dashboard.
2. Navigate to the Performance tab to view:
   • Latency Trends: Average processing time over time.
   • Success Rate: Percentage of successful executions.
   • Throughput: Volume of data processed per unit time.
   • Cost Metrics (if applicable): Estimated costs associated with processing.

---

Analyzing Metrics by Step

1. Select a specific step in the Pipeline Map.
2. The Step Metrics view shows:
   • Latency for the step.
   • Error rates specific to this step.
   • Processing volume.

---

Identifying Bottlenecks

1. Look for steps with:
   • High latency compared to others.
   • Frequent retries or high error rates.
2. Use the Logs tab to correlate metrics with specific inputs or execution times.

---

Setting Alerts

1. Use the Alerts feature to monitor pipeline health.
2. Configure alerts for:
   • Error rates exceeding a threshold.
   • Latency spikes.
   • Drops in throughput.

---

Next Steps

• Editing and Versioning Pipelines