Forum Discussion

Rookarumba's avatar
Rookarumba
Icon for Helper III rankHelper III
8 years ago

Apply Query Changes : Taking too long , like hours or so

Hi Everyone,   My "Apply query changes' is taking far too long. This wasn't the case when I was working on the same dataset (2m rows) of data.   Recently I did some changes and removed some of th...
Need Help
v-yuta-msft's avatar
v-yuta-msft
Icon for Community Support rankCommunity Support
8 years ago

Hi Rookarumba,

 

Query in power query is slower than database. It is not recommended to implement queries on big data frequently in power bi. As a workaround, you can do these operations in database.(e.g.: merge(join), append(union all)).

 

Regards,

Jimmy Tao

Rookarumba's avatar
Rookarumba
Icon for Helper III rankHelper III
8 years ago

Unfortunately, i don't have the luxury of having a database since the files are data dump by another source.

 

Thus I'm using PQ to work on those data on a Quarterly basis.

 

The weird thing is, i work on a previous copy and it seem fine, just not sure why this copy doesn't work after i edited some of the M  codes

  • Anonymous's avatar
    Anonymous
    Not applicable
    8 years ago

    I am having a similar issues where I am attempting to load a query from an analysis services connection.  The report says it has loaded 970k rows which soulds reasonable, but it seems to be hung up in finishing the job.  I've been watching the load for about 45 minutes and am hesitate to walk away for fear that it will time out.  Once I get the initial load in I can apply some filters to better scale the data, but I just need to finalze the data connection.  My first instinct was to load everything then scale back, but I suppose the next attempt is to load limited data then ramp up.  Any other suggestions for a relative novice/non-programmer?

    • Rookarumba's avatar
      Rookarumba
      Icon for Helper III rankHelper III
      8 years ago

      Anonymous , 

       

      my current workaround is rewriting the queries with R instead of M.

      So instead of waiting for up to 2 hours for the queries to finish loading, R can finish the job within 15 mins.

       

      Hope this help

      • Anonymous's avatar
        Anonymous
        Not applicable
        8 years ago

        Thanks for the info.  I have not yet done queries in R but will investigate.