Dataflow refresh started failing today MashupException.Error

[JE_test]

Hi!

I've had about 90 dataflows set up for a few months now. Last night all but 2 of them failed with error MashupException.Error

The two that succeeded were very small tables with less than 100 rows of data.

I'm loading data from an on-prem SQL server, as well as an Excel-file from a Sharepoint folder (this one also failed).

On-prem-server:

Excel-file:

Has there been any change in Fabric in the last 36 hours?

best regards

[Element115]

@pqian_MSFT my sysadmin added these endpoints to the firewall rules:

• Protocol: TCP
• Endpoints: *.datawarehouse.pbidedicated.windows.net, *.datawarehouse.fabric.microsoft.com, *.dfs.fabric.microsoft.com
• Port: 1433

as per the MS documention:  On-premises data gateway considerations for data destinations in Dataflow Gen2 - Microsoft Fabric | ...

For some reason, my sysadmin said there is an issue with the last endpoint: *.dfs.fabric.microsoft.com. He couldn't raise it. Could there be some other endpoint to add to the firewall rules?

But he was able to ping the LH SQL endpoint:

[pqian_MSFT]

Pinging is not enough, you'd probably at least want 

Test-NetConnection [address] -Port 1433

As we have seen with other reports, there may be other issues preventing a successful connection, such as:

- TLS issues

- Certificate validation issues

- Issues not related to SQL endpoint, such as getting to the management endpoints like api.powerbi.com.

The GW additional logging will reveal the exact problem limiting the connectivity.

[Element115]

Understood.  As soon as my sysadmin becomes available again, he'll do this today and I'll send the results+logs.

[pqian_MSFT]

Sounds good - please make sure the additional logging is on, and THEN try to repro, capture the session ID with that repro so we can correlate with the logs. When the repro session is over, close the editor and then go export the GW logs

[pqian_MSFT]

and no, old OnPrem SQL version does not prevent you from connecting back to Lakehouse

[miguel]

Hey! Jumping in for Peter, please post this as a new idea in the Fabric ideas portal:

https://aka.ms/FabricIdeas

We don't have an ETA or a plan for this at the moment, but we will definitely take any ideas posted in the ideas portal into consideration for future changes of the product or new experiences / features.