Hello All, I have a report which is using 20 SQL views and I am doing few transformations on each, then disabling their load and then creating a UNION of all 20 (the business need is in such a way that I have to have a UNION in place), the data is very small in total and loads super fast (1 minute 20 seconds avg.) when it is only for the 20 views, when it comes to the UNION it takes around 29 minutes!!! I don't get why is it doing that, I added Table.Buffer on all views even though it was not needed and I am wondering what is causing this slow performance. Also, will Table.Buffer help prior to the Table.Combine in the UNION query? Any help would be awesome! Thank You

Are you importing the entire dataset and then making transformations? If yes, then it will give you slower performance. You can write a SQL query and import the transformed data. It will give you much faster results.

I have actually removed the Power Apps data and just kept the UNION but it still takes long. I am going to redo a few things today and see where it takes me.

I am having the same issue. The union function has slowed down my model dramatically. I am joining multiple tables that each calculates supervisor hierarchies at different points in time (path function). Have you explored simply a limitation with your machine? I noticed that my CPU usage and Memory (20 Gb) is maxed out the entire time. Prior to adding the union function, my model would max out resources but get through jobs in a manageable amount of time. I was wondering if anyone on this string has used virtual machines, with more power, to refresh their data models - could that be a solution? (I am a complete newb to virtual machines and looking forward to seeing what community has to say). I am hoping there is a model solution and not a "throw more memory at it" solution. Thank you!

So what I did do was change the M for each of the 20 views, instead of it navigating to full hierarchy of the Schema under which they were against, I referenced the view directly. I used to have VM memory issues and raising it helped for sure. I also unchecked the 'Allow data preview option...'

Hi nirvana_moksh On PowerBI, are you using Import mode or Direct Query ? When I was using DirectQuery it was the problem, it was too slow. The solution was to import data - Quentin

Union and Merging Slowing Performance Terribly

11 Replies

Anonymous
Not applicable
8 years ago
Are you importing the entire dataset and then making transformations? If yes, then it will give you slower performance. You can write a SQL query and import the transformed data. It will give you much faster results.
- nirvana_moksh
  Impactful Individual
  8 years ago
  I am refrencing each view individually and navigating to that view alone and then performing the needed transformations on each view.
quentin_vigne
Solution Sage
8 years ago
Hi nirvana_moksh

On PowerBI, are you using Import mode or Direct Query ?
When I was using DirectQuery it was the problem, it was too slow. The solution was to import data

- Quentin
- nirvana_moksh
  Impactful Individual
  8 years ago
  I am using import mode for each of the 20
  Views, no direct query for now.
  - quentin_vigne
    Solution Sage
    8 years ago
    nirvana_moksh
    
    Did you try not doing UNION and creating relation between tables on PowerBI ?
    
    Else, are you using every column on your 20 tables ? I had the same issue, and creating view of my table with only the needed columns and keeping data only after 2013 solved my problem

Forum Discussion

Union and Merging Slowing Performance Terribly

11 Replies

Related content

Performance + Understanding: UNION, Append, Merge

Power Query Terrible Performance

MERGE QUERIES

List.PositionOf > performance than Merge Queries?

Async merge risk