Forum Discussion
Need Help: Fuzzy Match / merging two big files
Hi,
I have two big files and I would like to merge them. Can I limit the specific columns from both files that I intend to merge? Because I tried several times now and it's taking me very, very long time -- like its been 2 hours and it's still not finished or still merging.
I started with the first file, Edit Query, then Merge Query New, then identified the two files and the field name common to both files, click on Fuzzy Match box, and specified 80% matching rate. Then, click on OK.
As I went back to the merge file under Table, to the right most column is the merged second file which I only specified the columns I need, then click on OK. At this stage, the merge file is compose of: (1) 100% of the first file + (2) 10% of the second file.
This is taking time... So, do you think, I can delete columns I do not need in the first file? So, the merged file size will be reduced? And will cut down on Refreshing time?
Looking forward.
Thanks,
Noel
1 Reply
Probably won't help as merges are notoriously slow.
However - you do have options. Change the merge order, use custom column generators etc.
Please provide sample data (with sensitive information removed) that covers your issue or question completely, in a usable format (not as a screenshot). Leave out anything not related to the issue.
If you are unsure how to do that please refer to https://community.fabric.microsoft.com/t5/Community-Blog/How-to-provide-sample-data-in-the-Power-BI-Forum/ba-p/963216
Please show the expected outcome based on the sample data you provided.
If you want to get answers faster please refer to https://community.fabric.microsoft.com/t5/Desktop/How-to-Get-Your-Question-Answered-Quickly/m-p/1447523
