topic Re: Data Flow debugging does not start in IR Virtual Network Mode. in Dataflow

Data Flow debugging does not start in IR Virtual Network Mode.

nichiek — Fri, 22 Nov 2024 16:18:03 GMT

Hello everyone,

I have a problem with Integretion runtimes and Managed Private Endpoint, from data flow with my on prem SQL. I followed this official guide link

The VPN is ok, I can call my SQL from Azure VM and back. In a my pipiline, test connection to my table in my on prem SQL is ok

Only when I need to use my dataset from dataflow, I can't start debugging. Error details: Internal server error executing the request.

I can't understand where find more details about the problem.

Re: Data Flow debugging does not start in IR Virtual Network Mode.

Anonymous — Mon, 25 Nov 2024 04:44:37 GMT

Hi nichiek ,

Here are my thoughts about your problems. I think you can do these steps below:

1. Look at the logs for your self-hosted integration runtime (SHIR). You can find these in the Windows Event Viewer under the "Integration Runtime" section. This can provide more specific error messages.

You can read this document below:

Troubleshoot the self-hosted integration runtime in Microsoft Purview | Microsoft Learn

2. Ensure that your SHIR can resolve and connect to the necessary endpoints. Use tools like nslookup and Test-NetConnection to verify name resolution and connectivity to your on-premises SQL Server and Azure Data Factory endpoints.

You can read this document below:

Troubleshooting private endpoint configuration for Microsoft Purview accounts | Microsoft Learn

3. High memory or CPU usage on the SHIR machine can cause issues. Check the resource usage and ensure that the machine meets the recommended configurations.

You can read this document below:

Troubleshoot self-hosted integration runtime - Azure Data Factory & Azure Synapse | Microsoft Learn

Best Regards

Yilong Zhou

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Re: Data Flow debugging does not start in IR Virtual Network Mode.

nichiek — Tue, 26 Nov 2024 12:18:47 GMT

Hi Yilong Zhou,

all your suggestions are related to Self Hosted Integration, but as I specified, I can't use this method,

as Microsoft writes "Linked service with self-hosted integration runtime is not supported in data flow"

I can only use IR with Vnet as indicate here https://learn.microsoft.com/en-us/azure/data-factory/tutorial-managed-virtual-network-on-premise-sql-server