March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early bird discount ends December 31.
Register NowBe one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now
Hi guys, how are you?
I need some help loading data.
I have 3 folders with various CSV files. Through Power Query, I did all the necessary transformations and even merged all the Tables to transform into one and made the separation of Dimensions and Facts Tables.
I don't know for sure how many rows the table gives, as I don't know where I can see it through Power Query, but from columns there are 32 columns.
When I close and apply to load the data into the report for me to start taking DAX measurements and working on top of my report, it takes a long time to load. I left it just over an hour charging, and it still didn't charge. It crashes at the size of Mega Bytes in each of the tables after a certain time loading and doesn't load completely, to the point where the Tables appear in the report area. I disabled the loading of Main Tables, which I used to separate into Facts and Dimensions Tables, that is, leaving only the auxiliary Tables, and even then the loading time never closes at the end. I haven't tested it for more than 2 hours to see if it charges. But even so, can anyone help me with a more effective and faster solution?
Anything I can do to make it faster and get the same end result I want.
OBS.: I merged everything, because the Tables are from different customers, but with the same columns, and in the report I want to create a page with the result of all added together and other pages with the same graphics and visuals, but filtered for each specific customer.
Solved! Go to Solution.
It really depends on the data. Power Query will not show you how many rows there are unless you go to the Transform tab and click on the Row Count button, but that will process everything to do it.
3 folders of various CSV files doesn't tell me much. If those CSVs are 10-15GB each, then yeah, that will take a while. It also depends on the transformations. The total dataset could be 50K records (small) but if you are doing something like a table scan in Power Query (using Table.SelectRows inside a custom column for example) then that won't load. Power Query is horrible at that kind of thing.
So to help, we need a lot more information.
How to get good help fast. Help us help you.
How To Ask A Technical Question If you Really Want An Answer
How to Get Your Question Answered Quickly - Give us a good and concise explanation
How to provide sample data in the Power BI Forum - Provide data in a table format per the link, or share an Excel/CSV file via OneDrive, Dropbox, etc.. Provide expected output using a screenshot of Excel or other image. Do not provide a screenshot of the source data. I cannot paste an image into Power BI tables.
DAX is for Analysis. Power Query is for Data Modeling
Proud to be a Super User!
MCSA: BI ReportingIt really depends on the data. Power Query will not show you how many rows there are unless you go to the Transform tab and click on the Row Count button, but that will process everything to do it.
3 folders of various CSV files doesn't tell me much. If those CSVs are 10-15GB each, then yeah, that will take a while. It also depends on the transformations. The total dataset could be 50K records (small) but if you are doing something like a table scan in Power Query (using Table.SelectRows inside a custom column for example) then that won't load. Power Query is horrible at that kind of thing.
So to help, we need a lot more information.
How to get good help fast. Help us help you.
How To Ask A Technical Question If you Really Want An Answer
How to Get Your Question Answered Quickly - Give us a good and concise explanation
How to provide sample data in the Power BI Forum - Provide data in a table format per the link, or share an Excel/CSV file via OneDrive, Dropbox, etc.. Provide expected output using a screenshot of Excel or other image. Do not provide a screenshot of the source data. I cannot paste an image into Power BI tables.
DAX is for Analysis. Power Query is for Data Modeling
Proud to be a Super User!
MCSA: BI ReportingMarch 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!
Your insights matter. That’s why we created a quick survey to learn about your experience finding answers to technical questions.
Arun Ulag shares exciting details about the Microsoft Fabric Conference 2025, which will be held in Las Vegas, NV.