Forum Discussion
Error loading data to LakeHouse
Hi Ira_27,
Thank you for reaching out to Microsoft Fabric Community Forum.
The error message "invalid partition lengths" you are encountering while loading data into Lakehouse suggests an issue with the partitioning configuration during the copy activity.
Please ensure that the data type of your partition column (OrderDate) is consistent and valid. If it is a date column, verify that all values adhere to the expected date format without any anomalies or incorrect formats that might cause invalid partition lengths.
Since the process initially worked for one month of data but failed for another, check for discrepancies in the data for the previous month. Look for any unexpected formats in the OrderDate column that could disrupt the partitioning logic.
If this post helps, then please consider Accepting as solution to help the other members find it more quickly, don't forget to give a "Kudos" – I’d truly appreciate it!
Regards,
Vinay Pabbu
Hi Ira_27,
Thank you for reaching out to Microsoft Fabric Community Forum.
The error message "invalid partition lengths" you are encountering while loading data into Lakehouse suggests an issue with the partitioning configuration during the copy activity.
Please ensure that the data type of your partition column (OrderDate) is consistent and valid. If it is a date column, verify that all values adhere to the expected date format without any anomalies or incorrect formats that might cause invalid partition lengths.
Since the process initially worked for one month of data but failed for another, check for discrepancies in the data for the previous month. Look for any unexpected formats in the OrderDate column that could disrupt the partitioning logic.
If this post helps, then please consider Accepting as solution to help the other members find it more quickly, don't forget to give a "Kudos" – I’d truly appreciate it!
Regards,
Vinay Pabbu
Anonymous After i posted it i figured it out about the partition incorrect format. It was using SQL datetime column as partition column and when i changed it to "yyyyMMdd" it worked fine.
Exactly like you explained! Thanks