Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Register now to learn Fabric in free live sessions led by the best Microsoft experts. From Apr 16 to May 9, in English and Spanish.

Reply
dgfortunato
New Member

Astronomical Load times/Program to clean/transform data before Power Query?

Hi all,

 

I've run into a problem with Power Query while working on projects that require a large amount (and recenty, even very few) of transformations before I begin working. The program slows down to an absolute crawl, taking hours upon hours to even load a preview, much less load the data into the model. Naturally, if I need to do a lot of cleaning (120+ transformations), this makes progress very difficult and if something goes wrong somewhere in the process, it can result in a huge loss of time. Just recently, it took all night to load in a table that had one custom date column and a group by done to it. This is a major roadblock for me and very frustrating, so I was curious if any other users had suggestions. I've tried clearing the data cache, disabling parallel loading, disabling background data previews from downloading, increasing Maximum Memory Used, but all have had a minimal effect. Is there perhaps a program with good compatibility for PowerBI that would allow me to do the cleaning/transforming outside of PowerQuery, but still allow me to refresh the data on desktop and when published?

1 REPLY 1
watkinnc
Super User
Super User

I bet that if you showed us some of your code, we could probably help you out pretty quick.

 

--Nate


I’m usually answering from my phone, which means the results are visualized only in my mind. You’ll need to use my answer to know that it works—but it will work!!

Helpful resources

Announcements
Microsoft Fabric Learn Together

Microsoft Fabric Learn Together

Covering the world! 9:00-10:30 AM Sydney, 4:00-5:30 PM CET (Paris/Berlin), 7:00-8:30 PM Mexico City

PBI_APRIL_CAROUSEL1

Power BI Monthly Update - April 2024

Check out the April 2024 Power BI update to learn about new features.

April Fabric Community Update

Fabric Community Update - April 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors