Forum Discussion
smjzahid
Helper V
Helper VPower Query or Azure Data Factory ADF V2 When to use one over the other
I would like to know when it becomes more sensible to use ADFV2 (Mapping Dataflow) for data transformation. At my workplace we use Power Query and Power BI dataflow as well as Power Platform dataflow...
I guess that the difference is that ADFV2 let you save the results of the transformations. Personally I would store them in parquet format o feather file format to improve space or performance.
In PowerQuery the result is stored in-memory in the model each time you refresh. So if you have a large database maybe it makes sense to store old transactions already transformed, transform on the spot only new transactions and append bith of them in to the PowerBI model.
Probably you save tons of time loading huge models this way. Once transformed (1 run of the ADFV2 pipeline) you simply read from it as a Source of your model without so much data wrangling...