Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get Fabric certified for FREE! Don't miss your chance! Learn more

Write V-Ordered delta lake tables using Polars

We love Polars. It is user friendly and it works great for our data volumes.

 

Today, V-Order can be applied to delta parquet tables using Spark notebooks, but not Python notebooks.

 

Please make it possible to apply V-Order to delta parquet tables using Polars in pure python notebooks.

 

We encourage Microsoft to cooperate closer with Polars, as most customers can save a lot of CUs (money) by switching from Spark (distributed compute) to Polars (single node).

Status: New
Comments
deborshi_nag
Memorable Member
I totally agree, since Polars is included and pre-installed in Fabric Python notebooks, it would be good to have a mechanism to write parquet with V-Order Optimised data.