Forum Discussion

sam333's avatar
sam333
New Member
2 years ago
Solved

Record all the applied steps in Dataflow/power query editor with Dates-Activity logs

Hi Team,

I have a table in  dataflow and applied some transformations on that .

table name:Empdetails

initial table is in below snap

 

i have applied some transformations on that like below

 

#"Renamed columns" = Table.RenameColumns(#"Navigation 2", {{"nam$e", "name"}, {"ag*e", "age"}, {"gen_der", "gender"}, {"sala@@ry", "salary"}, {"id_?", "id"}}),
  #"Uppercased text" = Table.TransformColumns(#"Renamed columns", {{"location", each Text.Upper(_), type nullable text}}),
  #"Split column by delimiter" = Table.SplitColumn(#"Uppercased text", "name", Splitter.SplitTextByDelimiter(" "), {"name.1", "name.2"}),
  #"Renamed columns 1" = Table.RenameColumns(#"Split column by delimiter", {{"name.1", "FirstName"}, {"name.2", "LastName"}}),
  #"Capitalized each word" = Table.TransformColumns(#"Renamed columns 1", {{"FirstName", each Text.Proper(_), type nullable text}}),
  #"Capitalized each word 1" = Table.TransformColumns(#"Capitalized each word", {{"LastName", each Text.Proper(_), type nullable text}})
in
  #"Capitalized each word 1"
 
final Dataflow table is like below

 

 Applied transformations are:
Transformations 1-Renaming column
Transformations 2-Upper case
Transformations 3-Split column
Transformations 4-Renaming column
Transformations 5- Capitalization
 
I have no issue with code and transforamtions.
 
so in adavnce query editor we will get all the M code,
but here i need to record the activity log time and date
Eg:
Transformations 1-Renaming column  9/1/2023 18:05
Transformations 2-Upper case  9/1/2023 18:06
Transformations 3-Split column  9/1/2023 18:07
Transformations 4-Renaming column  9/1/2023 18:08
Transformations 5- Capitalization  9/1/2023 18:10
like this, if in future if i apply any change in any one of the transformations, then i need to capture that date and time and person name who changed that transformation, 
I know we dont have this option in Dataflow/PQE as of now, but i need to achieve this.
 
after creating dataflow, i will call that dataflow into the pipeline and after that by using script activity we may achiieve that(i heard it some where), but i am not getting any idea to achieve this by using script activity
 
can some body help me to get out of this.
TIA
 
 

 

 

 

 

 



Need Help
pipelines
  • miguel's avatar
    miguel
    2 years ago

    Hi!

    What you could potentially do today is try to use a Git-like approach where you copy your M script into a repository that will track the changes of your M script. That way you can see who committed what and when did it occur.

     

    At the moment this functionality is not available today in Powe Query or Dataflows, but you can post this as a new idea on the Fabric Ideas site:

    https://aka.ms/FabricIdeas 

1 Reply

  • miguel's avatar
    miguel
    Community Admin
    2 years ago

    Hi!

    What you could potentially do today is try to use a Git-like approach where you copy your M script into a repository that will track the changes of your M script. That way you can see who committed what and when did it occur.

     

    At the moment this functionality is not available today in Powe Query or Dataflows, but you can post this as a new idea on the Fabric Ideas site:

    https://aka.ms/FabricIdeas