Forum Discussion
Apply same transformations to multiple tables/excel sheets
- 3 years ago
That's what I meant when I wrote: "Apply the transforms against one of the sheets or files, then extract the code into a function, then apply that function to all sheets or files".
A parameter can be fed from a list query. But that's rather pointless as you can instead use that query directly in your ETL.
Hi guys,
I know, I am very late to this party, but I really like lbendlin's approach here: Outsourcing your M code transformations into functions and then reusing those to run against your target tables.
I happened to have written an article about this topic, where you first define your functions and then populate a configuration table specifying where you wanna apply those functions to. Finally a Data Quality Check / Cleaning function leverages the previous information to do the cleansing. It's a decently scalable approach since the logic is decoupled and can be reused easily as many times as you want. The blog article can be found here.
Hope this can help someone passing by this thread in the future 🙂
/Tom
https://www.tackytech.blog/
https://www.instagram.com/tackytechtom/