Forum Discussion
Does data cleaning automatically happen monthly?
- 4 months ago
hi kowas2
Since you steps involve combining worksheets then removing the duplicates, Power BI will remove the duplicates when you refresh the semantic model. Just be aware though that that Power BI will keep the first row it sees for each distinct value which may not be necessarily ordered by month.
- 4 months ago
Hello kowas2,
In Microsoft Power BI, your data cleaning steps (like Remove Duplicates) are saved in Power Query and only run when you refresh.
- Add new file → nothing happens yet
- Click Refresh (or use scheduled refresh)
- Power BI recombines files and removes duplicates again
You don’t need to remove duplicates manually each time.
If you want it monthly without action:
- Set up Scheduled Refresh in the Service
Hi kowas2,
Yes, Duplicate rows will get deleted automatically, in transfrom whatever stepe you perform are saved as applied steps which you can check on right side in Trasform data window.
🌟 I hope this solution helps you unlock your Power BI potential! If you found it helpful, click 'Mark as Solution' to guide others toward the answers they need.
💡 Love the effort? Drop the kudos! Your appreciation fuels community spirit and innovation.
🎖 As a proud SuperUser and Microsoft Partner, we’re here to empower your data journey and the Power BI Community at large.
🔗 Curious to explore more? [Discover here].
Let’s keep building smarter solutions together!