Starting December 3, join live sessions with database experts and the Microsoft product team to learn just how easy it is to get started
Learn moreGet certified in Microsoft Fabric—for free! For a limited time, get a free DP-600 exam voucher to use by the end of 2024. Register now
Hi,
A table can have multiple properties, such as the v-order optimization.
Some statements related to these properties are explained on the link https://learn.microsoft.com/en-us/fabric/data-engineering/delta-optimization-and-v-order?tabs=sparks...
We can use CREATE TABLE/ALTER TABLE/OPTIMIZE
However, the link doesn't explain how to use SHOW.
The traditional statement should be something like:
Hi
I tried also the GUI Optimizer, never noticed that before, when you right click on a table from the Fabric Lakehouse:
It ran witth success (it's still running spark behing the scenes), and even I can see my report is responding faster, and I am able to see parquet files have been merged and optimized.
But still the VOrder property doesn't show:
I wonder why...
Any updates on your side?
Thanks
@DennesTorres The traditional statement to see table properties is working fine from notebooks.
I just verified it using below code snippet
Hi,
I just tried it again and it's not working. Maybe I'm doing something wrong? I get a simple syntax error as feedback
Kind Regards,
Dennes
Hi,
After some more tests, I solved the problem of the SHOW statement, it was a silly mistake I did. %%sql only works if it's on the first line of the code block.
However, the final intended result didn't work. I was looking for discovering if the table was created using vorder optimization or optimizewrite, I was sure some of the tables were created with these features, while others were not, but the SHOW TBLPROPERTIES never show these properties.
What could I be doing wrong?
Kind Regards,
Dennes
You can check the value of particular property using following syntax
%%sql
SHOW TBLPROPERTIES dim_calendar ('delta.parquet.vorder.enabled');
Regards,
Chetna
Hi,
I tried as well. It always result that the table doesn't have this property.
I tried to drop and create the table again, in many different ways. I followed the guidance on https://learn.microsoft.com/en-us/fabric/data-engineering/delta-optimization-and-v-order?tabs=sparks....
All my attempts always result in "The table doesn't have this property".
One of my last attempts was this:
Kind Regards,
Dennes
Yes, it is bit unclear on how it picks the tblproperties, I tried few ways they didn't show the property value, when I tried below it works
cheers,
Chetna
Hi,!
Very interesting. I will need to investigate more. After all, this involves the v-order optimization of the files and if it doesn't work in some ways, there are more than one Microsoft tutorial with bad mistakes.
Thank you!
Kind Regards,
Dennes
Starting December 3, join live sessions with database experts and the Fabric product team to learn just how easy it is to get started.
Check out the November 2024 Fabric update to learn about new features.
User | Count |
---|---|
6 | |
4 | |
4 | |
4 | |
1 |
User | Count |
---|---|
16 | |
12 | |
9 | |
9 | |
4 |