Forum Discussion

khaskett's avatar
khaskett
Frequent Visitor
2 years ago
Solved

DataFlow Gen2 104100 Couldn't refresh the entity because of an internal error

Hi,  We've noticed issues ingesting data into both Lakehouse and Warehouse Fabric artifacts using Dataflow gen2. We consistently get the following error during the 'write data to destination' activi...
Dataflows
Need Help
  • v-cboorla-msft's avatar
    v-cboorla-msft
    2 years ago

    Hi khaskett 

     

    Thanks for using Microsoft Fabric Community.

    Apologies for the inconvenience that you are facing here.

    When using Microsoft Fabric Dataflow Gen2 with an on-premises data gateway, you might encounter issues with the dataflow refresh process. The underlying problem occurs when the gateway is unable to connect to the dataflow staging Lakehouse in order to read the data before copying it to the desired data destination. This issue can occur regardless of the type of data destination being used.

    Please refer to the documentation for additional information.

     

    I hope this information helps. Please do let us know if you have any further questions.

     

    Thanks.

     

v-cboorla-msft's avatar
v-cboorla-msft
Icon for Microsoft Employee rankMicrosoft Employee
2 years ago

Hi khaskett 

 

Thanks for using Microsoft Fabric Community.

Apologies for the inconvenience that you are facing here.

When using Microsoft Fabric Dataflow Gen2 with an on-premises data gateway, you might encounter issues with the dataflow refresh process. The underlying problem occurs when the gateway is unable to connect to the dataflow staging Lakehouse in order to read the data before copying it to the desired data destination. This issue can occur regardless of the type of data destination being used.

Please refer to the documentation for additional information.

 

I hope this information helps. Please do let us know if you have any further questions.

 

Thanks.

 

khaskett's avatar
khaskett
Frequent Visitor
2 years ago

Hi v-cboorla-msft 

 

Thanks for your reply. The explanation makes sense with the connection between the staging lakehouse and the gateway.

 

We've added a firewall rule to allow the connection and now everything works as hoped.

 

Thank you!

  • v-cboorla-msft's avatar
    v-cboorla-msft
    Icon for Microsoft Employee rankMicrosoft Employee
    2 years ago

    Hi khaskett 

    Glad that your query got resolved.

    Please continue using Fabric Community for any help regarding your queries.