Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The ultimate Microsoft Fabric, Power BI, Azure AI & SQL learning event! Join us in Las Vegas from March 26-28, 2024. Use code MSCUST for a $100 discount. Register Now

Reply
S_Lokesh
New Member

Experiencing Performance Issues in Power BI due to Memory Consumption on "Apply & Close"

While working on my Power BI report, I am encountering significant performance degradation, particularly during the data transformation phase. I am applying multiple data transformation, merge queries and expanding the row. Expanding queries takes longer time. Upon applying and closing these transformations, the report takes an unexpectedly long time to load, and eventually, it crashes. 

 

When checking the Task Manager, I noticed that the memory is fully utilized by Power BI. Further investigation revealed multiple Mashup container tasks occupying the memory.

 

I am seeking guidance on how to address and resolve this memory consumption issue in Power BI.Any insights, best practices, or specific steps to optimize memory usage during data transformation and report loading would be highly appreciated.

2 REPLIES 2
v-shex-msft
Community Support
Community Support

HI @S_Lokesh,

It seems like you are used complex operation(e.g. merge, loop, invoke custom function)in power query. I'd like to suggest you try to use buffer functions to optimize your query performance.

Solved: When to use Table.Buffer - Microsoft Fabric Community

New Options For The Table.Buffer Function In Power Query 

Regards,

Xiaoxin Sheng

Community Support Team _ Xiaoxin
If this post helps, please consider accept as solution to help other members find it more quickly.
Sahir_Maharaj
Super User
Super User

Hello @S_Lokesh,

 

Here is some best practices to optimize memory usage and improve performance;

 

  1. Optimize your Data Model: Only work with only the necessary amount of data. Remove unused columns and filter out irrelevant rows as early as possible in your queries. Also ensure that columns are using the most efficient data type. (For example, use integers instead of strings for numerical identifiers)
  2. Streamline Queries: Be cautious with merging and appending queries as these operations can increase the data volume and complexity. Expanding columns can create a lot of additional data so be selective and only expand the necessary columns.
  3. Performance Tuning in Query Editor: Avoid Unnecessary Steps as each step in the query editor adds to the complexity. I've found that applying filters early in the query to reduce the amount of data that needs to be processed. If you're working with large datasets, consider using incremental loading which allows you to load only new or changed data instead of the entire dataset.

Some additional resources that might assist you:

Should you have any questions or further assistance, please do not hesitate to reach out to me.


Did I answer your question? Mark my post as a solution, this will help others!

If my response(s) assisted you in any way, don't forget to drop me a "Kudos" 🙂

Kind Regards,
Sahir Maharaj
Data Scientist | Data Engineer | Data Analyst | AI Engineer
P.S. Want me to build your Power BI solution?
➤ Lets connect on LinkedIn: Join my network of 13K+ professionals
➤ Join my free newsletter: Data Driven: From 0 to 100
➤ Website: https://sahirmaharaj.com
➤ Email: sahir@sahirmaharaj.com
➤ Want me to build your Power BI solution? Lets chat about how I can assist!
➤ Join my Medium community of 30K readers! Sharing my knowledge about data science and artificial intelligence
➤ Explore my latest project (350K+ views): Wordlit.net
➤ 100+ FREE Power BI Themes: Download Now
LinkedIn Top Voice in Artificial Intelligence, Data Science and Machine Learning

Helpful resources

Announcements
Fabric Community Conference

Microsoft Fabric Community Conference

Join us at our first-ever Microsoft Fabric Community Conference, March 26-28, 2024 in Las Vegas with 100+ sessions by community experts and Microsoft engineering.

February 2024 Update Carousel

Power BI Monthly Update - February 2024

Check out the February 2024 Power BI update to learn about new features.

Fabric Career Hub

Microsoft Fabric Career Hub

Explore career paths and learn resources in Fabric.

Fabric Partner Community

Microsoft Fabric Partner Community

Engage with the Fabric engineering team, hear of product updates, business opportunities, and resources in the Fabric Partner Community.