Forum Discussion

Dpujara's avatar
Dpujara
Regular Visitor
2 years ago

DataPipeline - DataType issue

Hello,

 

We are pusing data to the Lakehouse using the DataFlow and once data is avilable to the Lakehouse, we are trying to push the data from Lakehouse to Warehosue using Data Pipeline. so, while runnig the Data Pipeline, Copy activity take the Default datatype as Nvarchar(Max) which is not support by Data Warehouse and pipeline got an error(DataType).

Below scrrenshot for your reference:

 

Data Warehouse

3 Replies

  • v-cboorla-msft's avatar
    v-cboorla-msft
    Microsoft Employee
    2 years ago

    Hi Dpujara 

     

    Thanks for using Microsoft Fabric Community.

     

    Fabric data warehouse stores data in Parquet files, a columnar format optimized for analytics. Since Parquet doesn't support NVARCHAR (used for storing Unicode characters), Fabric data warehouse doesn't directly support nvarchar. Instead, it recommends using varchar for storing text data. Since Fabric prioritizes efficiency for large datasets, it uses varchar for simplicity. 

     

    For more details please refer : Data types in Warehouse

     

    I hope this information helps. Please do let us know if you have any further queries.

     

    Thank you.

    • v-cboorla-msft's avatar
      v-cboorla-msft
      Microsoft Employee
      2 years ago

      Hi Dpujara 


      We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet.
      In case if you have any resolution please do share that same with the community as it can be helpful to others.
      Otherwise, will respond back with the more details and we will try to help.

       

      Thanks.

      • v-cboorla-msft's avatar
        v-cboorla-msft
        Microsoft Employee
        2 years ago

        Hi Dpujara 

         

        We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others .
        If you have any question relating to the current thread, please do let us know and we will try out best to help you.
        In case if you have any other question on a different issue, we request you to open a new thread.

         

        Thanks.