Forum Discussion
compress dataset
Hello Community,
I have a Dataset used by a user who every time create new measure or update something in the power query, would refresh the dataset on the desktop and then publish it.
The DataSet size is now over 1gb and it's taking considerable time in the auto refresh of Power Update app (it does auto refresh every 5 mins)
I would like to reverse the the amount of records in the Desktop Dataset, and Let Power BI Service query the refresh.
Is there anyway I can reverse the data size in power query to minimize the dataset size?
Much appreciated,
5 Replies
HI majdkaid22
Do you just want to reduce the amount of time taken refreshing when building the reports, or for just refreshing a published report?
What is your underlying data source?
You could set a filter on your dataset to only bring in recent records?
Perhaps remove unnecesssary columns and make sure you don't have any columns in your largest tables that have Datetime fields that include hours/mins/seconds (convert these to Date only column, and have a 2nd column for Hours/minutes if needed)
Just some ideas.
Phil_Seamark thanks mate. all the above have been taken into consideration already. we are in the FX Trading and I have tables with over 1m rows a day.
My data sources are SQL, MYSQL mainly
If your datasources is MS-SQL, have you considered building a summary table in SQL prior to Power BI rather than reading from raw tables?
What is the lowest grain you need to report on in Power BI? That would be the target level of summarisaion in SQL.
