Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get Fabric Certified for FREE during Fabric Data Days. Don't miss your chance! Learn more

Reply
vzbkb1
Helper II
Helper II

Load different files eliminating duplicates and keeping always the latest one

Every month I receive a file in excel with active users.  Each file will not contain the people active this month, but it will not contain the people that left from the previous month. 

 

My idea was to include all the files into the same directory and load all of them as they come.  My issues is that I do not know how I can tell powerQuery to load the.  Can you help me?

1 ACCEPTED SOLUTION
Anonymous
Not applicable

Hi @vzbkb1 ,

 

1. You can put these files into a folder and use the Folder connector to connect to these files.

vcgaomsft_4-1678326291126.png

2. Combine & Transform Data.

vcgaomsft_0-1678325842583.png

3. Remove [Source.Name] column.

vcgaomsft_1-1678325978566.png

4. Select the [Employee Number] and [Full Name] columns --> Remove Duplicates.

vcgaomsft_2-1678326055355.png

result.

vcgaomsft_3-1678326161768.png

Best Regards,
Gao

Community Support Team

 

If there is any post helps, then please consider Accept it as the solution  to help the other members find it more quickly. If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

How to get your questions answered quickly --  How to provide sample data in the Power BI Forum

View solution in original post

3 REPLIES 3
Anonymous
Not applicable

Hi @vzbkb1 ,

 

How are your files named?
Could you give sample data (without privacy) and give the expected output?

How to provide sample data in the Power BI Forum

This will be very helpful, thanks.

 

Best Regards,
Gao

Community Support Team

 

If there is any post helps, then please consider Accept it as the solution  to help the other members find it more quickly. If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

How to get your questions answered quickly --  How to provide sample data in the Power BI Forum

Let me provide you some examples 

 

File 1: Starting File

Employee Number

Full Name

1022

Santiago Garcia

1023

Luis Perez

1028

Carlos Rodriguez

1212

Ana Bel

752

Luz Dia

12

Hugo Caro

2154

Lara Cas

255

Javier Ros

 

File 2: A new file where the employee 255 (Javier Ros) has left, and a new employee has join (233 Clara Perez)

Employee Number

Full Name

1022

Santiago Garcia

1023

Luis Perez

1028

Carlos Rodriguez

1212

Ana Bel

752

Luz Dia

12

Hugo Caro

2154

Lara Cas

233

Clara Perez

 

At this moment the Output should be.  It will contain the people in file 1 and also the newones from file 2

Employee Number

Full Name

1022

Santiago Garcia

1023

Luis Perez

1028

Carlos Rodriguez

1212

Ana Bel

752

Luz Dia

12

Hugo Caro

2154

Lara Cas

255

Javier Ros

233

Clara Perez

 

And then we receive the file 3

 

Employee Number

Full Name

1022

Santiago Garcia

1023

Luis Perez

1028

Carlos Rodriguez

12

Hugo Caro

2154

Lara Cas

233

Clara Perez

 

Where employee 1212 and 752 have left but the resulting file should still contain all as before

Employee Number

Full Name

1022

Santiago Garcia

1023

Luis Perez

1028

Carlos Rodriguez

1212

Ana Bel

752

Luz Dia

12

Hugo Caro

2154

Lara Cas

255

Javier Ros

233

Clara Perez

 

 

In general the idea is always adding the new people coming in without losing in the report that people that have left

 

Anonymous
Not applicable

Hi @vzbkb1 ,

 

1. You can put these files into a folder and use the Folder connector to connect to these files.

vcgaomsft_4-1678326291126.png

2. Combine & Transform Data.

vcgaomsft_0-1678325842583.png

3. Remove [Source.Name] column.

vcgaomsft_1-1678325978566.png

4. Select the [Employee Number] and [Full Name] columns --> Remove Duplicates.

vcgaomsft_2-1678326055355.png

result.

vcgaomsft_3-1678326161768.png

Best Regards,
Gao

Community Support Team

 

If there is any post helps, then please consider Accept it as the solution  to help the other members find it more quickly. If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

How to get your questions answered quickly --  How to provide sample data in the Power BI Forum

Helpful resources

Announcements
Fabric Data Days Carousel

Fabric Data Days

Advance your Data & AI career with 50 days of live learning, contests, hands-on challenges, study groups & certifications and more!

October Power BI Update Carousel

Power BI Monthly Update - October 2025

Check out the October 2025 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Solution Authors