Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
1 year ago

Fast Copy DataFlowGen2

Hi Team,

Im trying to move files from azure data lake gen2 to lakehouse in ms fabric through dataflowgen2 using fast copy.But every time i do it im getting following error.

 

 

 

is this an existing issue ? if not can you help me with resolving this issue?

Dataflow
Need Help

9 Replies

    • Anonymous's avatar
      Anonymous
      Not applicable
      1 year ago

      HI 

      Expiscornovus

      we are not trying to write the data into existing table. I have gone throught the document.

       

      We are trying to Move the files from azuredatalake gen 2 to fabric lakehouse . what will be the best appraoch using fast copy dataglow gen 2 feature.

       

      Regards,

      Shiva

       

       

      • SofBL's avatar
        SofBL
        Advocate II
        9 months ago

        Same kind of issue here,
        Using the Azure SQL DB connector I use a native sql query to load data into a new Lakehouse table. and then it states, We encountered an error while trying to validate the query for Fast Copy. I proceeded, publish and the refresh failed stating
        Fast Copy is not supported with the current set of transformations on the query

        but every requirement seems to be approved, the connector is supported 
        Lakehouse -> new table (no fixed schema), Replace data, Dynamic Schema 
        no transformations outside the native query. 
        there is just a link back to the https://learn.microsoft.com/en-us/fabric/data-factory/dataflows-gen2-fast-copy site but hey after reading that several times I am confused. This definitly requires a more detailed error message to help determine what goes wrong with the set up of fast copy.