Record all the applied steps in Dataflow/power query editor with Dates-Activity logs

sam333 — Fri, 01 Sep 2023 12:43:05 GMT

Hi Team,

I have a table in dataflow and applied some transformations on that .

table name:Empdetails

initial table is in below snap

i have applied some transformations on that like below

#"Renamed columns" = Table.RenameColumns(#"Navigation 2", {{"nam$e", "name"}, {"ag*e", "age"}, {"gen_der", "gender"}, {"sala@@ry", "salary"}, {"id_?", "id"}}),

#"Uppercased text" = Table.TransformColumns(#"Renamed columns", {{"location", each Text.Upper(_), type nullable text}}),

#"Split column by delimiter" = Table.SplitColumn(#"Uppercased text", "name", Splitter.SplitTextByDelimiter(" "), {"name.1", "name.2"}),

#"Renamed columns 1" = Table.RenameColumns(#"Split column by delimiter", {{"name.1", "FirstName"}, {"name.2", "LastName"}}),

#"Capitalized each word" = Table.TransformColumns(#"Renamed columns 1", {{"FirstName", each Text.Proper(_), type nullable text}}),

#"Capitalized each word 1" = Table.TransformColumns(#"Capitalized each word", {{"LastName", each Text.Proper(_), type nullable text}})

#"Capitalized each word 1"

final Dataflow table is like below

Applied transformations are:

Transformations 1-Renaming column

Transformations 2-Upper case

Transformations 3-Split column

Transformations 4-Renaming column

Transformations 5- Capitalization

I have no issue with code and transforamtions.

so in adavnce query editor we will get all the M code,

but here i need to record the activity log time and date

Eg:

Transformations 1-Renaming column 9/1/2023 18:05

Transformations 2-Upper case 9/1/2023 18:06

Transformations 3-Split column 9/1/2023 18:07

Transformations 4-Renaming column 9/1/2023 18:08

Transformations 5- Capitalization 9/1/2023 18:10

like this, if in future if i apply any change in any one of the transformations, then i need to capture that date and time and person name who changed that transformation,

I know we dont have this option in Dataflow/PQE as of now, but i need to achieve this.

after creating dataflow, i will call that dataflow into the pipeline and after that by using script activity we may achiieve that(i heard it some where), but i am not getting any idea to achieve this by using script activity

can some body help me to get out of this.

TIA

Re: Record all the applied steps in Dataflow/power query editor with Dates-Activity logs

miguel — Tue, 05 Sep 2023 15:07:08 GMT

Hi!

What you could potentially do today is try to use a Git-like approach where you copy your M script into a repository that will track the changes of your M script. That way you can see who committed what and when did it occur.

At the moment this functionality is not available today in Powe Query or Dataflows, but you can post this as a new idea on the Fabric Ideas site:

https://aka.ms/FabricIdeas

topic Re: Record all the applied steps in Dataflow/power query editor with Dates-Activity logs in Dataflow

Record all the applied steps in Dataflow/power query editor with Dates-Activity logs

Re: Record all the applied steps in Dataflow/power query editor with Dates-Activity logs