Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
7 years ago
Solved

How do you manage refresh and reports update efficiently ?

Hey community,

 

I struggle pretty hard with reports updates and upload.

We have a database hosted on local servers (Postgres SQL private servers) and only accessible via gateway, I personnally work locally with my 4go of ram computer and it takes ages to load my reports and even longer to refresh and upload them (30 mins refresh and uploads) whereas I have just 10 million rows of data (500 mega). 

 

What I do now is refreshing from the web using my computer as a VPN with "on premise data gateway" software, however when I have to do a SQL query update or a report update it takes me ages to upload...

 

1. Is it possible just to import a portion of data to work on a sample dataset, upload and then refresh from PBI cloud ?

2. Is my uploading time normal ? Can't I just publish a report without erasing the latest dataset on the PBIcloud ? 

 

 

 

If you guys have other ideas of how to manage refreshes and publishing your work efficiently I'll take it all, I just feel like I'm doing it the wrong way.

 

Thanks in advance, 
Leo

  • Hi Anonymous

    1.

    if you want to refresh a portion of data of the dataset not the whole, you could consider Incremental refresh, it would refresh less data to reduce overall consumption of memory and other resources.

    https://docs.microsoft.com/en-us/power-bi/service-premium-incremental-refresh

     

    2.

    Speed Depends on your datasource and architecture.

    If you are using import mode, i would recommend you to read this article to make better architecture.

     

    You could publish your report without erasing the latest dataset on the PBIcloud by not clicking on "replace" on the pop-up window, thus you would have lastest dataset along with the new published dataset on power bi service.

     

    Best Regards

    Maggie

     

3 Replies

  • v-juanli-msft's avatar
    v-juanli-msft
    Community Support

    Hi Anonymous

    1.

    if you want to refresh a portion of data of the dataset not the whole, you could consider Incremental refresh, it would refresh less data to reduce overall consumption of memory and other resources.

    https://docs.microsoft.com/en-us/power-bi/service-premium-incremental-refresh

     

    2.

    Speed Depends on your datasource and architecture.

    If you are using import mode, i would recommend you to read this article to make better architecture.

     

    You could publish your report without erasing the latest dataset on the PBIcloud by not clicking on "replace" on the pop-up window, thus you would have lastest dataset along with the new published dataset on power bi service.

     

    Best Regards

    Maggie

     

    • Anonymous's avatar
      Anonymous
      Not applicable

      Thanks a bunch for those tips I had already seen those articles to be honest but I did not know it was not mandatory to click on the "replace" button thats kinda gonna change the game =D 

       

      I'll look up incremental refresh but from what I understand it's only available for premium users and i'm only a pro user :/ 

       

      Thank you have a good day,

      L

    • Anonymous's avatar
      Anonymous
      Not applicable

      If you have time, could you briefly define or explain what is a view versus a table ? 
      In the article, Marco takes as granted that I should know what's the difference however the newbie I am does not have a clue... 

       

      That's why I can't use most tips of the article...

      But I feel like I'm importing the tables.

      Thanks again,

      L