Forum Discussion

Matheuspeppers's avatar
Matheuspeppers
Frequent Visitor
3 years ago
Solved

How to replicate all the Applied Steps from one base to another?

Hi guys! I have 6 clients, where each of them have 3 similar databases, in which I will need to merge the tables. However, my question is... What I will do in one base, which is get the data throug...
  • jbwtp's avatar
    jbwtp
    3 years ago

    HJi Matheuspeppers,

     

    you can of course duplicate the queries and modify input individually, but this would mean a bit of headache if you ever come to modify the steps.

     

    I would go with something like this, if you feel comfortable.

     

    Let's assume that you have a query like this:

    let
        Source = Excel.Workbook(File.Contents("\\ClientFolder#1\Demo PQ.xlsx"), null, true),
        Table = Source{[Item="P_L",Kind="Table"]}[Data],
        #"Kept First Rows" = Table.FirstN(Table,15),
        #"Removed Other Columns" = Table.SelectColumns(#"Kept First Rows",{"Account", "31/03/2022", "31/03/2021", "31/03/2020"}),
        #"Filtered Rows" = Table.SelectRows(#"Removed Other Columns", each ([#"31/03/2022"] <> 0))
    in
        #"Filtered Rows"

     

    Assuming that I have another 2 similar files, which should be processed completely identical, I can convert it into something like this:

    let 
        Source = {
                "\\ClientFolder#1\Demo PQ.xlsx",
                "\\ClientFolder#2\Demo PQ.xlsx",
                "\\ClientFolder#3\Demo PQ.xlsx"
        },
    
        f = (path as text)=>
            let
                Source = Excel.Workbook(File.Contents(path), null, true),
                Table = Source{[Item="P_L",Kind="Table"]}[Data],
                #"Kept First Rows" = Table.FirstN(Table,15),
                #"Removed Other Columns" = Table.SelectColumns(#"Kept First Rows",{"Account", "31/03/2022", "31/03/2021", "31/03/2020"}),
                #"Filtered Rows" = Table.SelectRows(#"Removed Other Columns", each ([#"31/03/2022"] <> 0))
            in
                #"Filtered Rows",
        
        process = List.Accumulate(Source, {}, (a,n)=> a & {f(n)}),
        output = Table.Combine (process)
    in output

     

    Now the exact same steps applied to all three files. If the files require different steps to bring them to a uniformed look before applying common steps, it can be transformed as following:

    let 
        Source = {
                Query1,
                Query2,
                Query3
        },
    
        f = (t as table)=>
            let
                #"Removed Other Columns" = Table.SelectColumns(t,{"Account", "31/03/2022", "31/03/2021", "31/03/2020"}),
                #"Filtered Rows" = Table.SelectRows(#"Removed Other Columns", each ([#"31/03/2022"] <> 0))
            in
                #"Filtered Rows",
        
        process = List.Accumulate(Source, {}, (a,n)=> a & {f(n)}),
        output = Table.Combine (process)
    in output

    In this case, I assumed that we need to keep different number of rows in each file (Query1,2,3 are responsible for this), but the rest of the steps are the same for all three files.

     

    Kind regards,

    John