Forum Discussion

lucasgalde's avatar
lucasgalde
Regular Visitor
1 year ago
Solved

Error Loading Data from Dataflow Gen2 to Microsoft Fabric Data Warehouse

I am experiencing an issue with all my Dataflows Gen2 in Microsoft Fabric. The process loads the data successfully but fails to transfer it to the Fabric Data Warehouse. The error message received is...
data warehouse
  • v-nmadadi-msft's avatar
    v-nmadadi-msft
    1 year ago

    Hi lucasgalde ,

    Please chcek if these two scenarios are inadvertently causing the error:

    The error message suggests a data type mismatch between your pre and post refresh data. For example, a column that previously contained datetime values is now containing only date values which may inadvertently cause the error.

    Another possible reason for the issue, as you mentioned not encountering the error in Azure SQL Database and Lakehouse, could be that the data includes a datatype that is unsupported by Fabric Warehouse.
    Document to check what data types are not supported by Warehouse:
    Data types - Microsoft Fabric | Microsoft Learn


    If you find this post helpful, please mark it as an "Accept as Solution" and consider giving a KUDOS.
    Thanks and Regards

v-nmadadi-msft's avatar
v-nmadadi-msft
Community Support
1 year ago

Hi lucasgalde,
Thanks for reaching out to the Microsoft fabric community forum.

To Add to the valuable points mentioned by nilendraFabric, Disabling the staging feature in Power Query appears to have resolved the issue. Users have reported that, after making this change, the loading speed improved significantly—averaging less than five minutes—while occurrences of the error became rare.

If you find this post helpful, please mark it as an "Accept as Solution" and consider giving a KUDOS.
Thanks and Regards

  • lucasgalde's avatar
    lucasgalde
    Regular Visitor
    1 year ago

    Hi v-nmadadi-msft,

    Thank you for your response!

    In my case, my Gen2 is connected to a Fabric Data Warehouse, where enabling the staging option is mandatory. Because of this, I am unable to disable it to test this solution. 

    Best regards

    • v-nmadadi-msft's avatar
      v-nmadadi-msft
      Community Support
      1 year ago

      Hi lucasgalde ,

      Please chcek if these two scenarios are inadvertently causing the error:

      The error message suggests a data type mismatch between your pre and post refresh data. For example, a column that previously contained datetime values is now containing only date values which may inadvertently cause the error.

      Another possible reason for the issue, as you mentioned not encountering the error in Azure SQL Database and Lakehouse, could be that the data includes a datatype that is unsupported by Fabric Warehouse.
      Document to check what data types are not supported by Warehouse:
      Data types - Microsoft Fabric | Microsoft Learn


      If you find this post helpful, please mark it as an "Accept as Solution" and consider giving a KUDOS.
      Thanks and Regards