Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get certified in Microsoft Fabric—for free! For a limited time, the Microsoft Fabric Community team will be offering free DP-600 exam vouchers. Prepare now

Reply
biuser98
Helper II
Helper II

ALM toolkit deletes my partitions

I have fact table which is configured to refresh incrementelly.

Since it is a large dataset, i have manually loaded the data for the partitions in SSMS.

My fact table got a new column, so I used ALM toolkit to detect the change and updated the change to the service.

I have used the following options:

Retain partitions - unchecked (since I need to pull the data from the source)

Process only affected tables checked.

Procces mode - Do not proces , because I want to process the partitions in SSMS in batch and not all partitions at once  (otherwise it will run ouf memory of gives an error)

I have updated the dataset with the new column, and when I went back to SSMS to see the partitions, all partitions got deleted and i got one partition with 0 rows (I lost all the data of the dataset for that fact table)

 

I need help, what am I doing wrong?

 

 

8 REPLIES 8
Erokor
Resolver II
Resolver II

I second @lbendlin however, there are some specific options you'll want to set when using ALM toolkit to make metadata only changes to prevent partitions from being wiped out - I use this often and the following is what I suggest:

Erokor_0-1697032238652.png

 

Thanks, one question: for table updates, retain refresh policy , should this be checked?

 

 

This depends on what you are trying to do. If you are trying to do updates without refreshing the model/partitions - set the items appropriately. There is a ton of detailed information on GitHub, here

can u explain further? Should I enable it for my dataset to not lose my partitions?

for "Retain Refresh Policy" if you have a refresh policy set in the service, I would leave this checked or enable it. My understanding of the setting is that if there is a refresh policy on the Symantic Model (Dataset), it will be kept.

lbendlin
Super User
Super User

Retain partitions - unchecked (since I need to pull the data from the source)

That's your problem.  Should have checked that. 

 

It is generally easier to alter partitions from SSMS.

I have checked it now. But how should I load in the data again if I may ask?

Make sure your partitions are provisioned/bootstrapped.

Use SSMS, Powershell or any other XMLA frontend to issue the partition refresh commands, one after the other.

Helpful resources

Announcements
OCT PBI Update Carousel

Power BI Monthly Update - October 2024

Check out the October 2024 Power BI update to learn about new features.

September Hackathon Carousel

Microsoft Fabric & AI Learning Hackathon

Learn from experts, get hands-on experience, and win awesome prizes.

October NL Carousel

Fabric Community Update - October 2024

Find out what's new and trending in the Fabric Community.

Top Solution Authors
Top Kudoed Authors