Forum Discussion
westf
1 year agoRegular Visitor
Problem loading Lakehouse file/table into warehouse
Hello, I'm facing issues loading data from Fabric Lakehouse Table/File to Fabric Warehouse. Below is my notebook code. Im using pyspark lakehouse_table_path = f"{lakehouse_path}/Tables/{...
Srisakthi
Super User
1 year agoHi westf ,
It seems like there is an issue in datetime data type. Can you check your mapping function . datetime2(6) should be used.
Ref : https://learn.microsoft.com/en-us/fabric/data-warehouse/data-types
Regards,
Srisakthi
- westf1 year agoRegular Visitor
Hello, Thanks for the reply. I don't have any problem creating the table in Warehouse because im generating the create sql. The problem is when i try to push the data frame data into the newly created sql table.
For some reason, though i set that to APPEND, it is trying to create another table by itself and i have no control over the create df.to_sql.