topic Staging Blob storage account Private Endpoint Access from Data Pipeline Errors in Fabric platform

Staging Blob storage account Private Endpoint Access from Data Pipeline Errors

CloudMatrix42 — Fri, 14 Feb 2025 18:30:23 GMT

Hi,

I have a data pipeline with a copy data function that fetches data from a database, and I am trying to use an Azure storage account for staging the data. The storage account does not have public access, it has a private endpoint, and I am using a fabric data gateway to connect. The connection is successful when I test it, I am also able to list the content of the storage account when clicking browse for "Storage path" under settings. However, when I run the pipeline it fails with - Failed to resolve connection. I am using storage account key for authentication for this test. Has anyone else done this? Is there anything else I need to do to make it work?

Would appreciate any recommendation, thanks.

Re: Staging Blob storage account Private Endpoint Access from Data Pipeline Errors

nilendraFabric — Fri, 14 Feb 2025 18:56:15 GMT

Hello CloudMatrix42

give it a try

Verify Managed Private Endpoint Configuration
• Ensure you have created a Managed Private Endpoint in your Fabric workspace to securely connect to the Azure Blob storage account:
1. Navigate to your Fabric workspace settings.
2. Go to the Network security tab and create a managed private endpoint by specifying the resource ID of your Azure Blob storage account.
3. Approve the private endpoint request in the Azure portal under the “Private endpoint connections” section of your Blob storage account.
• Confirm that the private endpoint’s status is marked as Succeeded in both Fabric and Azure portals

Re: Staging Blob storage account Private Endpoint Access from Data Pipeline Errors

CloudMatrix42 — Fri, 14 Feb 2025 19:21:48 GMT

Hi @nilendraFabric ,

Do I need a Managed Private Endpont if I am using the virtual network data gateway?

Re: Staging Blob storage account Private Endpoint Access from Data Pipeline Errors

nilendraFabric — Fri, 14 Feb 2025 19:25:05 GMT

Sorry I missed that part

No, you do not need a Managed Private Endpoint if you are using the Virtual Network Data Gateway to connect to your private endpoint-enabled Azure Blob.

Re: Staging Blob storage account Private Endpoint Access from Data Pipeline Errors

v-saisrao-msft — Wed, 19 Feb 2025 11:16:44 GMT

Hi CloudMatrix42,

I wanted to check if you had the opportunity to review the information provided by nilendraFabric . Please feel free to contact us if you have any further questions. If my response has addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.

Thank you.

Re: Staging Blob storage account Private Endpoint Access from Data Pipeline Errors

Jeroenski74 — Fri, 21 Feb 2025 06:19:02 GMT

Is the storage account in the same Region as your Fabric capacity? And if it is ensure that the private endpoint is created in the same Region as the region of the VNET Data Gateway. The endpoint created must be of the dfs type in order for the Fabric API to work with it.

Hope this helps

Re: Staging Blob storage account Private Endpoint Access from Data Pipeline Errors

v-saisrao-msft — Sat, 22 Feb 2025 16:25:05 GMT

Hi CloudMatrix42,

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you.

Re: Staging Blob storage account Private Endpoint Access from Data Pipeline Errors

v-saisrao-msft — Wed, 26 Feb 2025 17:20:58 GMT

Hi CloudMatrix42,

We haven’t heard back from you regarding your issue. If it has been resolved, please mark the helpful response as the solution and give a ‘Kudos’ to assist others. If you still need support, let us know.

Thank you.