Forum Discussion
Gen2 Dataflows suddenly failing
Magically things started working again.
Because magic.
Hi!
id recommend reaching out to the support team by raising a support ticket so our team of engineers can take a closer look at your specific Dataflows:
Been a while now I had our sysadmin update the firewall rules and multiple DFs had no issue ingesting from the on-prem DB until last Friday. Although last Friday, I asked the sysadmin to add this to the FW rules, as per the MS documentation, as this endpoint is new and wasn't mentioned a couple of weeks ago: *.dfs.fabric.microsoft.com .
Also, should have said this was another test of DF at the behest of the SE, case #2401190040000098.
I notified the SE of the failure of the test he asked me to perform, so I guess, no need to open a new support ticket. This is what he asked me to do:
We got an update from Product team.
We suspect the issue could be related to missing configuration in the Gateway to allow reaching to the Lakehouse storage.
Please try out the following steps and provide the outcome of two refreshes:
1. Create a new dataflow A with a simple query (blank table) that is using the Lakehouse storage as output destination and then try to refresh the dataflow.
2. Create a new Dataflow B with an entity that uses a data source that utilizes the GW and configure the Lakehouse as the output destination and then refresh the Dataflow.