Forum Discussion
1.000.000 Row Question
Hello lbendlin:
i can't aggregate the data. The data in question has a high cardinality. As mentioned in my first post. Per day 240 values, 7 days a week. So in 1 Month 7.2000 values. In 1 Year 86.400 values. So in 11 years 950.400 distinct values. Sometimes data is recorded every 5 min, distinct values.
So i understand there is a limitation of 1M rows as a result. that's ok. But currently my table in question has over 2M rows. So my question remains: Why can power BI Display all values over the whole project and doesn't show me an error? I get this little "i" which states in short:
this is a sample data. Filter your data.
you can deactivate the sample algorythm in the general settings pane of the visual. But the info about the sample presentation of my visual will still show that this is a sample.
So as i understand it: Power BI has a limitation of 3.500 datapoints in a linechart. Understood.
But how can it display, if i go over the whole runtime with over 2.000.000 rows?
What's your reason for using Direct Query? Would Import Mode be more appropriate? Incremental Refresh even? These options don't have the 1M rows limit.
Because we would like to have the newest values. If you go for Import i can schedule a refresh every 30 min for the whole day (48 times). This would be ok if new data is generated every hour or half hour. If the scenario requires that the data is generated every 5 min, than i have a problem. But again my question still is: why does it work? there are more than 1 million rows in database. in power bi service, if i select the whole time i get the result. it id working in direct conection with 2.000.000 rows. why?
Looks like you want to consider Incremental Refresh - It allows you to keep the latest partition (day) in direct query mode and everything else in import mode.
Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn