Skip to main content
Showing results for 
Search instead for 
Did you mean: 

The ultimate Microsoft Fabric, Power BI, Azure AI & SQL learning event! Join us in Las Vegas from March 26-28, 2024. Use code MSCUST for a $100 discount. Register Now

Resolver II
Resolver II

performance .parquet patitions datalake gen2

I am using .parquet partitions and I would like to know which is better, to have a single partition or many partitions, currently I have 24 partitions about 200mb each and power bi desktop gives me a memory error when i try to refresh.

I would like to know if processing small partitions can reduce memory usage?
greater number of partitions longer refresh time?
How do I know how much memory I need to do the refresh?  

Super User
Super User

Sounds more like a configuration issue on your datalake.  Which SKU are you running this on?

Helpful resources

Fabric Community Conference

Microsoft Fabric Community Conference

Join us at our first-ever Microsoft Fabric Community Conference, March 26-28, 2024 in Las Vegas with 100+ sessions by community experts and Microsoft engineering.

February 2024 Update Carousel

Power BI Monthly Update - February 2024

Check out the February 2024 Power BI update to learn about new features.

Fabric Career Hub

Microsoft Fabric Career Hub

Explore career paths and learn resources in Fabric.

Fabric Partner Community

Microsoft Fabric Partner Community

Engage with the Fabric engineering team, hear of product updates, business opportunities, and resources in the Fabric Partner Community.