Azure Data Factory Pipeline Monitoring Integration

A pipeline is a coherent collection of activities that work together to accomplish a goal. The pipeline allows you to manage activities as a set rather than one by one. You can deploy and schedule the Azure Data Factory pipeline instead of deploying and scheduling the activities separately.

With Site24x7's integration, you can now monitor your pipelines, get accurate metrics, set thresholds, automate tasks, and stay on top of outages.

Table of contents

• Setup and configuration
• Supported metrics
• Threshold configuration
• IT Automation
• Configuration Rules

Setup and configuration

You can add an Azure Data Factory pipeline while adding a new monitor or you can add it to an existing Azure monitor. Follow these steps to add the service.

Supported metrics

Metric name	Statistic	Unit
Succeeded Activity Runs	Average	Count
Failed Activity Runs	Average	Count
Cancelled Activity Runs	Average	Count

Threshold configuration

Global configuration

1. Go to the Admin section in the left navigation pane.
2. Select Configuration Profiles from the left pane and choose the Threshold and Availability (+) tab from the drop-down menu. Click Add Threshold Profile from the top-right corner.
3. Set the monitor type as Azure Data Factory Pipeline. Now you can set the threshold values for all the metrics mentioned above.

Monitor-level configuration

1. Go to Cloud > Azure and select Azure Data Factory Pipeline from the drop-down menu.
2. Choose a resource for which you would like to set a threshold, then click the hamburger icon . Select Edit, which will direct you to the Edit Azure Data Factory Pipeline Monitor page.

You can set the threshold values for the metrics by selecting Threshold and Availability. You can also configure IT Automation at the attribute level.

IT Automation

IT Automation in Site24x7 helps with automatically resolving performance degradation issues.

How to configure IT Automation for a monitor

Configuration Rules

Using Site24x7's Configuration Rules, you can configure parameters for multiple monitors such as Threshold Profile, Notification Profile, Tags, and Monitor Group.

How to add a Configuration Rule 

Related links:

How to add an Azure monitor.
How to integrate an Azure App Service monitor.
How to integrate Azure Virtual Machine monitor.
How to configure IT Automations for a monitor.
View the list of monitor reports.