Data Flow - IR TTL setting

[mlord]

Hello, we are facing an issue with a data flow performance issue and we would like to try to set the Time To Live setting to 10 min, since we have sequential data flows pulling data from an external API.  However, it seems we cannot set TTL in the JSON on an AutoResolveIntegrationRuntime IR, but yet we cannot use a self-hosted IR in a data flow, where the TTL can be set.  This feels like a vicious circle.  What am I missing?

Thank you,

Melissa

[v-sdhruv · Accepted solution]

Hi @mlord ,

AutoResolveIntegrationRuntime does not allow TTL configuration directly in JSON or UI. This IR is managed by Microsoft and dynamically resolves to the best region, but lacks customization options like TTL.. The quick re-use and TTL feature can only be used in a dedicated Azure Integration runtime.

You may want to switch to a Dedicated Azure IR-
Create a dedicated Azure Integration Runtime instead of using AutoResolve here TTL can be configured  (e.g., 10–30 minutes) to keep the cluster warm between executions.

You can even refer this article for more understanding-
Auto Resolve Azure Integration Runtime Vs. Dedicated Azure Integration Runtime

https://learn.microsoft.com/en-us/azure/data-factory/concepts-integration-runtime

Hope this clears some air!