Datasize and refresh problem

[Anonymous]

Hi guys,

I'm using a bigger dataset (1.5GB). All this data is stored in around 10 Excelfiles. 

My problem was not being able to refresh on my pc (it will crash while loading all those files) so I thought about putting the Dashboard on a ReportServer. My goal was to load all those files once via server, disable "include in report refresh" afterwards and never have to load the data on my pc again.

I changed the name of the folder with all the Excelfiles in it and created a new one with the smaller sample file. I closed and applied PQ and because the filesize is way smaller the pc didnt crash and the steps get applied.
I then uploaded the Dashboard onto the ReportServer, changed the Foldernames back to original, so that PQ will now refresh all files. Unfortunally it doesnt refresh the new files, but keeps the old samplefiles even after changing the foldernames

Do you guys have an idea why this happens? If you have a better solution for this amount of data I'm glad to hear about it.

Tyvm

[Anonymous]

Hi @Anonymous 
the problem is kind of solved. First I've learned PBI doesn't save/export changes to the data if you refresh it on the report server and download it afterwards. This feature seems to not exist. 

So my first solution was the one I described earlier, to only refresh it on report server and do a "sql-view" solution  like guy in the cube mentioned in his video ( by having 2 folder, one with all data and one with testdata - renaming them whenever I work on desktop with PQ )

But after a little bit more search I found out I could use parquet files to decrease filesize and now I'm loading the whole data even on desktop. I might changes this in the feature and combine it with the view-solution but for now this has to be good enough.

I would have loved to try all the other solution with incremental refresh/live datasets and so on but unfortunatly our corperate version doesn't support any of those.

[amitchandak · Accepted solution]

@Anonymous , The way to do is we load small data in the desktop file and load data in service.

Incremental ETL https://docs.microsoft.com/en-us/power-bi/connect-data/incremental-refresh-overview

refer : https://www.youtube.com/watch?v=qZOEDBedATA

[Anonymous]

Thanks a lot for the fast answer, I will look into those 

[Anonymous]

Hi @Anonymous ,

Could you tell me if your problem has been solved? If it is, kindly Accept the helpful reply as the solution. More people will benefit from it. Or you are still confused about it, please provide me with more details about your issue. 

Best Regards,

Rico Zhou