Forum Discussion
Solved
Combining Multiple Parquet files into a table in Dataflows Very Slow
I have two dataflows pointing to the same set of data. Dataflow A is on SQL server (on prem) and dataflow B is in multiple .parquet files that need to be combined into a single table. When I run ...
Turns out our best solution will be to spin up a vm, install a gateway on it, and use it for the dataflow refresh from alds gen2 datalakes.
Don't use an on-prem gateway for your Azure data sources. You may not even need a VNet gateway.
FYI you cannot use VNet gateway for power bi dataflows.
What is a virtual network (VNet) data gateway (Preview) | Microsoft Learn
I will look into other options and get back t oyou