Forum Discussion

amaaiia's avatar
amaaiia
Icon for Skilled Sharer rankSkilled Sharer
2 years ago

Add new column in Data Pipeline source as Date type

Hi, I'm trying to write some data with COPY activity into a lakehouse. I need to add a customized column to Destination lakehouse table. This column is a date. However, when I write it in the lakeho...
General Comment
Pipeline
FabianSchut's avatar
FabianSchut
Icon for Solution Sage rankSolution Sage
2 years ago

I did not test this myself, but in the Mapping settings, you are able to set the 'Type conversation settings'. This does not require a fixed data schema, but allows you to set a date string format that should be read as a date type. If you set the 'Date format' to "yyyy-MM-dd" in combination with your already formatted date string @{formatDateTime(item().file_date,'yyyy-MM-dd')}, it may work. Here is the documentation: https://learn.microsoft.com/en-us/fabric/data-factory/data-type-mapping.
Do note that not all sources are supported. The list of supported items is in the link.

  • amaaiia's avatar
    amaaiia
    Icon for Skilled Sharer rankSkilled Sharer
    2 years ago

    Hi,

    Not working. I've set Date format as I have specified in formatDateTime function 

     

    and if I check the destination table, the filed is still in string format: 

     

    • FabianSchut's avatar
      FabianSchut
      Icon for Solution Sage rankSolution Sage
      2 years ago

      Just to be sure, did you drop the table before running with this new setting?