Forum Discussion
Dataflow is creating complex type column in Lakehouse tables from Decimal or Currency type Yet Again
- 1 year ago
Yes that is correct. Convert the data to decimal type with precision of 2 in Delta Lake aka Lakehouse
Not clear. Where is the dataflows currancy type col. You should give some screenshots....???
Hi, I thought you would just trust me haha.
Lakehouse view:
The actual DFG2 feed:
- BhaveshPatel1 year agoSuper User
Hi lemaribdb
Databricks Delta Lake is an open source data lakehouse and implemented first even before Microsoft.
There is no data type called Currency Data Type in Delta Lake. It is decimal data type that are converted to Currency Data Type in Fabric SQL. For goodness of Microsoft
You can see the below screenshots of Delta Lake aka Lakehouse.
- lemaribdb1 year agoHelper II
Yes I'm aware but what is the solution then? The only option PQ for this type of data is either Whole Number, Decimal Number or currency. Where whole numbers is not precise enough and decimal number is unnecesary precision.
Shouldn't currency type just transform it into a decimal with 2 precision in Lakehouse, not a complex type? Is it beacuse currency tries to keep some currency type metadata?
Is my best bet just rounding those to 2 decimal place and feeding as decimal?- BhaveshPatel1 year agoSuper User
Yes that is correct. Convert the data to decimal type with precision of 2 in Delta Lake aka Lakehouse