Don't miss your chance to take the Fabric Data Engineer (DP-600) exam for FREE! Find out how by attending the DP-600 session on April 23rd (pacific time), live or on-demand.
Learn moreNext up in the FabCon + SQLCon recap series: The roadmap for Microsoft SQL and Maximizing Developer experiences in Fabric. All sessions are available on-demand after the live show. Register now
I am trying to understand how Power BI stores data.
If I append Table A to Table B to create Table C:
Does Power Query / Power BI duplicate the data from A & B to create C and store it twice thereby doubling the size of the file / data model?
( I am asking because I cannot disable the load of my tables, as I use SSMS to load data via XMLA endpoints. This is because the dataset is to large to publish, and it times out if I attempt to refresh it using native functionality in Power BI Service)
Hi @Anonymous
As far as I know, you're right. It stores data twice.
Thanks for your response!
Do you have a link to any documentation on the matter per chance?
Hi @Anonymous
The own documentation of Microsoft: https://learn.microsoft.com/en-us/power-query/append-queries Also, if you try to remove one of the appended tables it will give you an error. The only solution may be to apply SQL to join them before importing data into Power BI. There are lot of links on how to do it. For instance:
I appreciate your effort, unfortunately I did not see anything about the storing of data in the Microsoft documentation.
I don't have any issues or questions regarding how to Append or the behaviors, just the storage.
Thanks for your time 🙂
Just as a follow up - i use XMLA endpoints in SSMS, not SQL.
If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.
A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.
| User | Count |
|---|---|
| 5 | |
| 3 | |
| 3 | |
| 3 | |
| 2 |