The ultimate Microsoft Fabric, Power BI, Azure AI, and SQL learning event: Join us in Stockholm, September 24-27, 2024.
Save €200 with code MSCUST on top of early bird pricing!
Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started
Hi All,
Need your expertise suggestion and guidance on the below which iam facing.
i have a 2 fact tables which are having 360 and 330 miilions of rows and iam taking these tables from sql query into power bi with direct query and with direct query we have a limitation of 1M records.Need some suggestion on this to take data from SQL queries which has 660Million rows approximately.
Regards
Anitha.
Hi @Anonymous ,
//Need some suggestion on this to take data from SQL queries which has 660Million rows approximately.
If over 1 million rows are returned from Direct Query, Power BI returns an error (unless in Premium capacity, and the row count is under the admin-set limit) (1 million row limitation in direct query is the number of rows returned.)
Reference: Use DirectQuery in Power BI Desktop
Such queries can put a huge strain on the performance of data sources and reports. You need to optimize some queries, as Wu says, to filter out the required data.
DirectQuery model guidance in Power BI Desktop
Best Regards,
Gao
Community Support Team
If there is any post helps, then please consider Accept it as the solution to help the other members find it more quickly. If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!
How to get your questions answered quickly -- How to provide sample data
@Anonymous direct query isn't always good. Better to use import for performance wise. Can you give us a bit of context on what you trying to do with the data. I suggest filtering the tables with sql queries and don't pull the whole data. e.g., limit 100, filter recent date,etc.
Hi Ray_wu,
i have to create a power bi report using the sql queries which that much of Data.
Regards
Anitha.
there is a limit of 1m rows data.
https://docs.microsoft.com/en-us/power-bi/connect-data/desktop-directquery-about#other-implications
Not sure if the premium will increase the data capacity but either way you will have to filter down the fact tables, there no way you can load them into the report visual and even if it did the performance would take a long time to load. The only way i can think of is to optimize this query, such as using filters
Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.
Check out the July 2024 Power BI update to learn about new features.
User | Count |
---|---|
112 | |
108 | |
68 | |
46 | |
43 |
User | Count |
---|---|
188 | |
87 | |
77 | |
74 | |
60 |