Forum Discussion
Solved
Using Power Bi with Large Datasets
Hey folks, I have Power Bi desktop and a Azure SQL data source that contains 450 million rows of data. When I load the data into desktop or using Direct Query the time it takes is unreasonable. ...
Anonymous
I found that if I load by CSVs into Azure Data Lake Store I can use Azure Data Lake Analytics to choose the data I need and push that out to a new CSV. This new CSV should be below that 1GB limit anad therefore I can use ADLS as my Power Bi data source.
If the 1GB limit is reach I can split out the CSV and import them seperately combining them in Power Bi.
Thanks for the help,
J
I have had seen good performance with over 40 million records. How many tables are you importing and how many columns in each? Leveraging Power BI's relational model to reduce the column count in tables with large numbers of records helps in my experience.
I have eventually solved it using DirectQuery