Forum Discussion
lemaribdb
1 year agoHelper II
Dataflow is creating complex type column in Lakehouse tables from Decimal or Currency type Yet Again
Hi, I see similar topci got resolved as it stopped hapening. But I encountered it just now, my currency type cols are becoming complex type in Lakehouse... It's using replace, properly mapped cols a...
- 1 year ago
Yes that is correct. Convert the data to decimal type with precision of 2 in Delta Lake aka Lakehouse
lemaribdb
1 year agoHelper II
Yes I'm aware but what is the solution then? The only option PQ for this type of data is either Whole Number, Decimal Number or currency. Where whole numbers is not precise enough and decimal number is unnecesary precision.
Shouldn't currency type just transform it into a decimal with 2 precision in Lakehouse, not a complex type? Is it beacuse currency tries to keep some currency type metadata?
Is my best bet just rounding those to 2 decimal place and feeding as decimal?
BhaveshPatel
1 year agoSuper User
Yes that is correct. Convert the data to decimal type with precision of 2 in Delta Lake aka Lakehouse