Forum Discussion

dbalkin777's avatar
dbalkin777
Frequent Visitor
1 year ago
Solved

Merge Column from Folder Connector Query is Slowing Down PQ Performance

Greetings. One of my data sources is seval excel files combined using the folder connector (i.e., sample file --> final query with all excel files appended). Performance is fine in that final query, ...
Need Help
  • Anonymous's avatar
    Anonymous
    1 year ago

    Hi dbalkin777 ,
    Thanks for Jonvoge reply.
    You can try to reduce the table size by filtering out unnecessary rows before merging. Next, create indexes on the columns you want to merge. This can help Power Query perform merge operations more efficiently. Of course, you also need to make sure that the data types of the columns you want to merge are consistent. Mismatched data types can slow down the merge process.

    Best regards,
    Albert He

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

Jonvoge's avatar
Jonvoge
Most Valuable Professional
1 year ago

Hi dbalkin777

 

Not sure why it is running slower.

But perhaps you could put that part of the query into a dataflow, and then connect to the Dataflow from your Semantic Model (if you are indeed building a semantic model?), and merge the other data here?

Might be worth a shot for increasing performance.

_____________________________________________________
I hope my comment was helpful.
If your question was answered, please mark your post as 'Solved' and consider giving me a 'Thumbs Up'.
Find me on LinkedIn, Sessionize, or my blog Downhill Data

dbalkin777's avatar
dbalkin777
Frequent Visitor
1 year ago

Thanks for your reponse! That idea occurred to me too but I can't set up the gateway needed to go that route due to work restrictions.