Forum Discussion
compress dataset
HI majdkaid22
Do you just want to reduce the amount of time taken refreshing when building the reports, or for just refreshing a published report?
What is your underlying data source?
You could set a filter on your dataset to only bring in recent records?
Perhaps remove unnecesssary columns and make sure you don't have any columns in your largest tables that have Datetime fields that include hours/mins/seconds (convert these to Date only column, and have a 2nd column for Hours/minutes if needed)
Just some ideas.
Phil_Seamark thanks mate. all the above have been taken into consideration already. we are in the FX Trading and I have tables with over 1m rows a day.
My data sources are SQL, MYSQL mainly
If your datasources is MS-SQL, have you considered building a summary table in SQL prior to Power BI rather than reading from raw tables?
What is the lowest grain you need to report on in Power BI? That would be the target level of summarisaion in SQL.
Phil_Seamark that is a long term option which am working on. at the moment I have MYSQL DB which are a bit messy and I don't have the enough resources to structure views in there.
Guess I will have to try and go on another round of removing unrequired columns...
Cheers mate
Columns that have unique values are good ones to target. If you can get rid of these then your ability to compress will be improved.
Also if you can pivot data to be vertical rather than horizonal, this will help