Using Append to Make a new DataBase

[Anonymous]

Hi Everyone,

i have 6 tables of sales data with each table arround 27 Millions of lines. So what am i trying to do is to make 1 table that contains all of the data. I used the append option but now when i use apply changes it is loading this new table with 162 Millions of lines.  So my doubt is everytime i add more data for the "2018 sales Table"  my new table will load again the  data from the other 5 tables?

Thank your for your answers

[mwegener · Accepted solution]

Yes, Power Query creates a query which persist the data after execution.
By each load, the full query runs again.

[v-jiascu-msft]

Hi @Anonymous,

Could you please mark the proper answers as solutions?

Best Regards,

Dale

[v-jiascu-msft · Accepted solution]

Hi @Anonymous,

I would suggest you append them in the data source. For example, create a view with UNION ALL in the SQL database. Then you don't need to load 1 big table and 5 small tables. 

Please also refer to the premium-feature-incremental-refresh, which could avoid loading the whole table all the time.

Best Regards,
Dale

[mwegener · Accepted solution]

Yes, Power Query creates a query which persist the data after execution.
By each load, the full query runs again.

[Anonymous]

so its not like a copy is more like a mirror from each table ?

[mwegener]

Oracle would call it "materialized view".