Forum Discussion

ray_codex's avatar
ray_codex
Icon for Resolver II rankResolver II
1 year ago
Solved

Dataflow gen2 not loading date fields

Hi,   I have a dataflow g2 in a pipeline that loads data to a Lakehouse. Today I was working on my silver layer and noticed something really weird. All date columns are missing. First I thought it ...
workspaces
  • ray_codex's avatar
    ray_codex
    1 year ago

    The solution is mapping everything manually. Lakehouse can't handle date/time/zone fields of dataflows. Fabric is buggy sometimes. 

suparnababu8's avatar
suparnababu8
Icon for Super User rankSuper User
1 year ago

Hi ray_codex 

 

  • Yes, my be sometimes schema mapping b/w dataflow and lakehouse can get out of syncrnisations. So, try to refresh the schema mapping/importing the schema.
  • Make sure that, schemadrift is enable in datflow settings.It allows the dataflow to absorb the chnages in the schema. 

Pls go through below links. It might helps you.

data flow sink not showing one of the columns - Microsoft Q&A

Solved: Missing Columns in Dataflow Gen2 - Microsoft Fabric Community

Issue with Column Mapping in Azure Dataflow - "Column Not Found" Error - Microsoft Q&A

 

Thanks!!

 

Did I answer your question? Mark my post as a solution!

Proud to be a Super User!