ADF Pipelines GET Rest API and ADF Diagnostic Settings

[pchristinami]

Do you happen to know if the get pipeline API Pipelines - Get - REST API (Azure Data Factory) | Microsoft Learn gives the same information as ADF diagnostic settings? I have a use case where the data from the API are stored in a azure sql table and don't want to introduce diagnostic settings too if the information is the same?

I mainly want to create a alert if a copy activity lasts more than our SLA and I know how to do it with Diagnostic Settings and KQL but when I look at the REST API I don't think I can get the same information?

Any insight will be useful, thank you!

[pchristinami]

Thank you for confirming my thoughts!

[v-kongfanf-msft · Accepted solution]

Hi @pchristinami ,

The ADF Pipelines GET Rest API and ADF Diagnostic Settings have different purposes.

The former provides detailed information about the pipeline structure, activities and parameters while the latter is used to collect and route diagnostic logs and metrics for monitoring and alerting. Using the REST API alone does not provide the runtime metrics needed for this purpose.

For more details, you can refer to below document:

Configure diagnostic settings and a workspace - Azure Data Factory | Microsoft Learn

Pipelines - Get - REST API (Azure Data Factory) | Microsoft Learn

Best Regards,
Adamk Kong

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.