Forum Discussion
Refresh large datasets on Power BI service
- Anonymous6 years ago
Hi swethabonthu ,
You may following those tips to reduce the size of dataset or optimize the model of dataset based on this document, some tips may not reduce the time of refresh.
- Remove unused tables or columns, where possible.
- Avoid distinct counts on fields with high cardinality – that is, millions of distinct values.
- Take steps to avoid fields with unnecessary precision and high cardinality. For example, you could split highly unique datetime values into separate columns – for example, month, year, date, and so on. Or, where possible, use rounding on high-precision fields to lower cardinality – (for example, 13.29889 -> 13.3).
- Use integers instead of strings, where possible.
- Be wary of DAX functions, which need to test every row in a table – for example, RANKX – in the worst case, these functions can exponentially increase run-time and memory requirements given linear increases in table size.
- When connecting to data sources via DirectQuery, consider indexing columns that are commonly filtered or sliced again. Indexing greatly improves report responsiveness.
Or you can increase the timeout value in connector function.
Best Regards,
Jay
Community Support Team _ Jay Wang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Hi swethabonthu
You can use PBI Spy (www.pbispy.com) to quickly identify columns that are not being used.
Reach out to me if you need any assistance doing this.
- Anonymous5 years agoNot applicable
OMG! I wish I would have known about this before!!
I've been given a report with 5 tables, each one with about 350 columns, I was going crazy trying to figure out what data was really used.
THANK YOU!
- colivier5 years agoAdvocate I
Glad to be of assistance. This is the first real public release of PBI Spy. If anything does not work or is unclear please don't hesitate to contact me. I'm trying to make it as good as it can be, but it's a journey.
- Anonymous4 years agoNot applicable
tables with 350 columns? I wonder you use large datasets storage format on premium capacities? is it ok with model performance ? I mean P2 OR P3 premium capacity can keep good performance for large datasets with 350+columns talbes.