Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
Anonymous
Not applicable

Power Query Scrubbing- Business Case

I have a variety of data sources, that are all received form an emailed excel file (unfortunately I cannot connect driectly to database).

 

I have no problem joining them together and using power query.

 

however- one of the files essentially lists all the new construction projects. Part of our scrubbing (done in excel) is to use the Store No + Project ID to make a "key" column, and compare it to the new project list to see which projects are new that need to be added. Then projects that have fallen off of the current project list are moved to a different tab. 

 

I'm wondering if there is a way to do this within power query in Power BI. It would really save a lot of steps to automate this and be able to see the steps. 

I've only been in powerbi for about 5 months so still a newbie and not familiar with the full scrubbing capabilities.

1 ACCEPTED SOLUTION
v-danhe-msft
Microsoft Employee
Microsoft Employee

Hi @Anonymous,

From your description, could you mean to add new data to the old table? If so, you could append your data list and remove the duplicate columns:
Sample data:

Table A

1.PNG

Table B

2.PNG

Append as new:

1.PNG

Remove the duplicate columns and you could get the result:

1.PNG

 

Regards,

Daniel He

Community Support Team _ Daniel He
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

View solution in original post

3 REPLIES 3
v-danhe-msft
Microsoft Employee
Microsoft Employee

Hi @Anonymous,

Could you please tell me if your problem has been solved? If it is, could you please mark the helpful replies as Answered?

 

Regards,

Daniel He

Community Support Team _ Daniel He
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Anonymous
Not applicable

Hi @v-danhe-msft

 

yes, that would solve most of the issues, I think in order to track how many projects were removed (from the new vs old) I would need to just keep track of how many total rows in both sheets, and subtract from each other. 

v-danhe-msft
Microsoft Employee
Microsoft Employee

Hi @Anonymous,

From your description, could you mean to add new data to the old table? If so, you could append your data list and remove the duplicate columns:
Sample data:

Table A

1.PNG

Table B

2.PNG

Append as new:

1.PNG

Remove the duplicate columns and you could get the result:

1.PNG

 

Regards,

Daniel He

Community Support Team _ Daniel He
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Helpful resources

Announcements
FabCon Global Hackathon Carousel

FabCon Global Hackathon

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes!

September Power BI Update Carousel

Power BI Monthly Update - September 2025

Check out the September 2025 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Solution Authors
Top Kudoed Authors