Forum Discussion

FrancescoPwc's avatar
FrancescoPwc
Icon for Advocate I rankAdvocate I
2 years ago

[Fabric] Dataflow Gen 2: Write from CSV to Delta partitioned Table fails

I set up a Dataflow where I read from a csv, add a column X_DATE_REF valued "2024-07-05" and write to a previously created table in lakehouse.   The table is partitioned by column X_DATE_REF STRING...
Dataflows
Need Help
Anonymous's avatar
Anonymous
Not applicable
2 years ago

Hi FrancescoPwc ,

 

Although you mentioned setting columns to fixed values. However, based on the error reporting information you provided, it appears that one of your conversions has a changed type causing the data type to report an error. This is why you are getting the following error: DataFormat.Error;Microsoft.Data.Mashup.Error.Context = User.


You can troubleshoot the error in several ways as follows:

  • Ensure that the column X_DATE_REF in the CSV is of the same data type as in the table schema and is set to STRING correctly.
  • Verify the conversion in Dataflow to ensure that no other operation has accidentally changed the value of column X_DATE_REF.

Best Regards,
Adamk Kong

 

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.