Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes! Register now.

Reply
PaladPa
Regular Visitor

How to handing large dataset from Dynamics 365 BC

Hi , I'm connected the data from Dynamics 365 Business Central but the table I have to analyze is too large (more than 3m rows). , and when I select "close and apply" in Power Query, it takes a considerable amount of time, around 1-2 hours, to complete the query. Can you provide any suggestions on how I can optimize the loading time for the data?

 

PaladPa_0-1681295029322.png

 

1 ACCEPTED SOLUTION
v-jingzhang
Community Support
Community Support

Hi @PaladPa 

 

When the data size is too large, please check if you indeed need all rows and columns from that table? If some columns are not neccessary in the further analytics, you can use Power Query to remove those columns. Meanwhile, if some rows are not neccessary, filter out them too! Reducing the data volume to be imported into the model is usually the most effective method. 

 

If you cannot reduce the data size, you can consider moving all data from Dynamics 365 Business Central into a relational database e.g. a SQL Server database in advance. Then querying data from the database with Power BI Desktop. Loading data from the database may be faster. And if possible, you can consider using DirectQuery instead of Import mode when getting data from a database. With DirectQuery, it doesn't import all data but queries only the required data from the data source directly, which may make the analytics faster. However, DirectQuery has many limitations to improve the performance, so you need to take them into consideration before you want to use it. DirectQuery in Power BI - Power BI | Microsoft Learn

 

If you are going to publish your report into Power BI Service after the report is completed and use it in Power BI Service, and you can accept a subset of the table data when creating the report, you can set up the Power Query Parameters to filter only a subset of all rows in Power Query Editor and load them to create your report. After you complete the report, publish it to Power BI Service. Then go to the settings page of the dataset and change the parameter values there. Execute a refresh for the dataset in Power BI Service, then it will use the new parameter values in the refresh to query all data from the data source again. 

 

Best Regards,
Community Support Team _ Jing
If this post helps, please Accept it as Solution to help other members find it.

View solution in original post

1 REPLY 1
v-jingzhang
Community Support
Community Support

Hi @PaladPa 

 

When the data size is too large, please check if you indeed need all rows and columns from that table? If some columns are not neccessary in the further analytics, you can use Power Query to remove those columns. Meanwhile, if some rows are not neccessary, filter out them too! Reducing the data volume to be imported into the model is usually the most effective method. 

 

If you cannot reduce the data size, you can consider moving all data from Dynamics 365 Business Central into a relational database e.g. a SQL Server database in advance. Then querying data from the database with Power BI Desktop. Loading data from the database may be faster. And if possible, you can consider using DirectQuery instead of Import mode when getting data from a database. With DirectQuery, it doesn't import all data but queries only the required data from the data source directly, which may make the analytics faster. However, DirectQuery has many limitations to improve the performance, so you need to take them into consideration before you want to use it. DirectQuery in Power BI - Power BI | Microsoft Learn

 

If you are going to publish your report into Power BI Service after the report is completed and use it in Power BI Service, and you can accept a subset of the table data when creating the report, you can set up the Power Query Parameters to filter only a subset of all rows in Power Query Editor and load them to create your report. After you complete the report, publish it to Power BI Service. Then go to the settings page of the dataset and change the parameter values there. Execute a refresh for the dataset in Power BI Service, then it will use the new parameter values in the refresh to query all data from the data source again. 

 

Best Regards,
Community Support Team _ Jing
If this post helps, please Accept it as Solution to help other members find it.

Helpful resources

Announcements
September Power BI Update Carousel

Power BI Monthly Update - September 2025

Check out the September 2025 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.