Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

We've captured the moments from FabCon & SQLCon that everyone is talking about, and we are bringing them to the community, live and on-demand. Starts on April 14th. Register now

Reply
wilson_woon
Regular Visitor

remove duplicate headers after combining multiple files

Hi all,

 

I have several csv files to be combined together into a single file for editing and analysis. Each csv file has some headers and these headers are the same. As you can imagine, these headers will be included in the file. How do I remove these redundant headers in the Query Editor? The Remove Duplicates will do the job but I feel that it would remove duplicate data as well.

 

Thanks

 

1 ACCEPTED SOLUTION
Eric_Zhang
Microsoft Employee
Microsoft Employee

@wilson_woon

 

As the column names are known, you can remove the header rows with Table.RemoveMatchingRows.

Check

 

let
    Source = Table.FromRows({{"data1","data2","data3"},{"column1","column2","column3"},{"data1","data2","data3"}},{"column1","column2","column3"}),
    RemoveHeaders = Table.RemoveMatchingRows(Source,{[column1= "column1",column2= "column2",column3= "column3"]})
in
    RemoveHeaders

Capture.PNG

View solution in original post

2 REPLIES 2
nemo2601
New Member

Hi, 

Thanks for the solution! But wont it remove rows which are not headers with same data as well? I might be missing something, pls let me know. 

 

Thanks !

Eric_Zhang
Microsoft Employee
Microsoft Employee

@wilson_woon

 

As the column names are known, you can remove the header rows with Table.RemoveMatchingRows.

Check

 

let
    Source = Table.FromRows({{"data1","data2","data3"},{"column1","column2","column3"},{"data1","data2","data3"}},{"column1","column2","column3"}),
    RemoveHeaders = Table.RemoveMatchingRows(Source,{[column1= "column1",column2= "column2",column3= "column3"]})
in
    RemoveHeaders

Capture.PNG

Helpful resources

Announcements
New to Fabric survey Carousel

New to Fabric Survey

If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.

Power BI DataViz World Championships carousel

Power BI DataViz World Championships - June 2026

A new Power BI DataViz World Championship is coming this June! Don't miss out on submitting your entry.

Join our Fabric User Panel

Join our Fabric User Panel

Share feedback directly with Fabric product managers, participate in targeted research studies and influence the Fabric roadmap.

March Power BI Update Carousel

Power BI Community Update - March 2026

Check out the March 2026 Power BI update to learn about new features.