Forum Discussion
PQ in Azure Data Factory - Mashup Engine or Transposition
so, when using PQ from ADF, instead of my M expression being run by a mashup engine, it is never touched by a mashup engine but instead the M expression is simply translated into an ADF data flow (Spark) script and run by Spark
That's correct.
Hi Anonymous,
Thanks for this info!
Actually, my question is specifically about how Power Query works when used from ADF, not how it works in general.
I understand that "normal" Power Query (e.g. the PQ that ships with Power BI and Excel) uses the PQ mashup engine to evaluate M expressions and produce the requested output.
However, the quote from the above-mentioned article stating that ADF's PQ activity "translates your M script into a data flow script" makes me think that maybe the mashup engine is not involved at all when PQ is run from ADF—so, when using PQ from ADF, instead of my M expression being run by a mashup engine, it is never touched by a mashup engine but instead the M expression is simply translated into an ADF data flow (Spark) script and run by Spark.
Is that correct?
/CC: Ehren