Forum Discussion
j_hoolachan
3 years agoRegular Visitor
Direct Lake Mode error: "Class: 'ParquetException' Status: 'Unexpected end of stream'"
Hello, I have created a star schema using the TPCH10 benchmark dataset in two separate Power BI datasets: one uses import mode and one uses direct lake mode. The model is below. Fac...
- 3 years ago
This issue has been resolved. My dim and fact tables had skewed data which was causing the issue (somehow). Running OPTIMIZE on each of the tables and then refreshing my PBI dataset allowed the measures to calculate successfully.
One thing that is unclear to me: I explicitly enabled OptimizeWrite (and it's enabled by default https://learn.microsoft.com/en-us/fabric/data-engineering/delta-optimization-and-v-order?tabs=sparksql#what-is-optimized-write) so why were explicit OPTIMIZE commands required as well? I assumed OptimizeWrite would result in...optimized writes...
kydang
3 years agoNew Member
Hello,
Do you have any update on this topic, I'm having the same issue with directlake.
Thanks