Dynamic name extraction.

[Anonymous]

Hello All, 

I have around 43 tables in power bi desktop which I want to append into one table. But I also want to add a column that has the Table names in it corresponding to each row.

I did see many solutions regarding this on community but in all those i have to enter the table name manually, which I want to avoid at all costs since there are so many tables.

Below is the Output I want

I need a dynamic solution for this. Is it possible?

Thanks in advance

Chahat

[Mariusz]

Hi @Anonymous 

Cool, I think there might be a better way.

In Query Editor.

1. Create a Blank Query and Past the below, into the Advanced Editor 
   

   let
       Source = PowerBI.Dataflows([])
   in
       Source

   this will create a table with all workspaces that are available to you.
2. Find the workspaceName and click on [Data] Column > "Folder", this will show you a list of all the dataflows within that workspace.
3. Find your workspace and click on [Data] Column > "Database", this will the list of all the tables within this dataflow.
4. Now, select entity ( your table names ) column and Data Column and Right Click > Remove Other Columns
5. you should have a table like below.
    
   All you need to do now is expanding your tables by clicking on the highlighted arrows and selecting the columns to expand.

Best Regards,
Mariusz

If this post helps, then please consider Accepting it as the solution.

Please feel free to connect with me.

[Anonymous]

@Mariusz  actually after we get tables from the dataflow we are doing a data profiling transformations on all of them so that we can get information about their columns and than appending them.  How will I do this tranformations then.

Table.Profile(Table 1)

[Mariusz · Accepted solution]

Hi @Anonymous 

Profiling is easy you can reference this table and add extra column like below.

The transformation could be done in a similar way however I would advise creating a function for transformations.

Another option would be doing all the transformation in dataflows.

Best Regards,
Mariusz

If this post helps, then please consider Accepting it as the solution.

Please feel free to connect with me.

[Anonymous]

@Mariusz  Yes. I did try that. Still the expand step is taking like forever. I dont know whats wrong with it.

ThankYou very much though. I appreciate your help.

Regards,

Chahat

[Arjun_SP]

@Anonymous  I had a similar issue, the easiest thing to do is to load all the tables to SQL Server and then combine them and adding a simple query to get the table names appended and then feed to Power BI.

[Mariusz]

Hi @Anonymous 

Try something like this.

let
    Source = #shared,
    #"Converted to Table" = Record.ToTable(Source),
    #"Added Custom" = Table.AddColumn(#"Converted to Table", "Custom", each  Type.Is( Value.Type( [Value] ), type table)  ),
    #"Filtered Rows1" = Table.SelectRows(#"Added Custom", each not ([Name] = "Query1")),
    #"Filtered Rows" = Table.SelectRows(#"Filtered Rows1", each ([Custom] = true))
in
    #"Filtered Rows"

Best Regards,
Mariusz

If this post helps, then please consider Accepting it as the solution.

Please feel free to connect with me.

[Anonymous]

@Mariusz thankyou for the solution. It does seem to work but when I expand the value column, it gets stuck after loading around just 190 rows and I have like 45 Tables and stays that way forever. Also I want to remove all the tables after appending them. Just so there is only one main table. 

[Mariusz]

Hi @Anonymous 

Where do these tables come from?

Many Thanks

Best Regards,
Mariusz

If this post helps, then please consider Accepting it as the solution.

Please feel free to connect with me.

[Anonymous]

@Mariusz PowerBI dataflows.

[Mariusz]

HI @Anonymous 

Is it all the same workspace and the same dataflow?

Many Thanks

Mariusz

[Anonymous]

@Mariusz Yes. All the tables are in one workspace and one dataflow of that workspace.

[Greg_Deckler]

What are these tables sources and I assume that these are all individual queries?