Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn the coveted Fabric Analytics Engineer certification. 100% off your exam for a limited time only!

Reply
Vipin
New Member

Merging multiple csv files

I have around 50 csv files with Timestamp and value like:

Timestamp                                         Value

Fri 01 Apr 2016 02:10:00 GMT        10

Fri 01 Apr 2016 02:15:00 GMT         20

Fri 01 Apr 2016 02:20:00 GMT          30

 

And another file 

Timestamp                                         Value

Fri 01 Apr 2016 02:10:00 GMT        8

Fri 01 Apr 2016 02:20:00 GMT        5

Fri 01 Apr 2016 02:25:00 GMT        6

 

In the above cases some time stamp are missing. I have them in the following format

Timestamp                                         Value         Value

Fri 01 Apr 2016 02:10:00 GMT        10                 8

Fri 01 Apr 2016 02:15:00 GMT         20                -

Fri 01 Apr 2016 02:20:00 GMT         30                5

Fri 01 Apr 2016 02:25:00 GMT          -                  6     

 

Thanks in advance.

 

 

2 REPLIES 2
pqian
Employee
Employee

@Vipin What is the desired result?

 

"Merge" queries is like a join, you are using timestamp as a key and joining them across a set of queries. If this is what you are after, then what you did is correct (and the output is correct too). Aside from the fact that timestamp isn't the best key to join with...

 

If you want to CONCATENTATE the csv files into one set of results with the same shape, then APPEND queries is what you should be using.

 

If you can define your scenario a little better, we can help you with ways to write the query in a more efficient manner.

Greg_Deckler
Super User
Super User

Right, you need to use multiple Merge queries.


@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
Mastering Power BI 2nd Edition

DAX is easy, CALCULATE makes DAX hard...

Helpful resources

Announcements
April AMA free

Microsoft Fabric AMA Livestream

Join us Tuesday, April 09, 9:00 – 10:00 AM PST for a live, expert-led Q&A session on all things Microsoft Fabric!

March Fabric Community Update

Fabric Community Update - March 2024

Find out what's new and trending in the Fabric Community.