Forum Discussion

cristinaojer's avatar
cristinaojer
Frequent Visitor
2 years ago

Can't load data from SQL Server into Lakehouse. Can't add a data destination.

I'm facing some issues when trying to get data from SQL Server database into Fabric Lakehouse. I'm using an on-premises data gateway updated up to it’s latest version.
  • We’ve tried to get this data through a Copy Activity. When running the pipeline, the process starts but never ends. We made a trial just o ingest 4 rows from the source table but the execution of the pipeline still never ends. Source data is read since we could preview it through ‘preview data’ button when configuring the activity. It seems the problem is when loading data into the lakehouse.
  • We’ve tried to get this data also through a Dataflow Gen2. In this case, we could query the source table and transform the data, but when trying to add a destination for the data, an unkwon error is reported

Is this a common error? How could we troubleshoot it?

Need Help

13 Replies

  • amitchandak's avatar
    amitchandak
    Super User
    2 years ago

    cristinaojer , For some customers it worked with the March 2024 gateway, but for some, it worked only with the April 2024 Gateway(Data Pipelines). But with April 2024 many of our dataflows are failing with false error.

    • v-cboorla-msft's avatar
      v-cboorla-msft
      Microsoft Employee
      2 years ago

      Hi cristinaojer 

       

      Thanks for using Microsoft Fabric Community. amitchandak thank you for sharing the details.

      As we have two releases in the month of April.

      April 2024 update (3000.218.8)

      April 2024 update (3000.218.7)

       

      Request you to install the latest version of on-prem gateway and try to establish the connection, this might help you.

      If the issue still persists, please do let us know we will try to help.

       

      Hope this helps.

       

      Thank you.

      • v-cboorla-msft's avatar
        v-cboorla-msft
        Microsoft Employee
        2 years ago

        Hi cristinaojer 

         

        We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others.
        Otherwise, will respond back with the more details and we will try to help.

         

        Thanks.

  • DerekCC's avatar
    DerekCC
    Regular Visitor
    2 years ago

    I am facing a very similar issue. On Prem SQL through an OPDG to a Lakehouse using CopyData. The table only has 7 rows, it previews, but it never writes any data; all I receive after it times out is a generic error: InternalServerError executing pipeline Fabric

    I just updated my OPDG to the most recent version (3000.218.9 - April 2024) in hopes that this would help, but no difference.

  • re84uk's avatar
    re84uk
    Helper I
    2 years ago

    We still have this issue, endless in progress status when attempting to load data from on-prem SQL Server to Lakehouse via on-prem gateway.  We have an MS support ticket logged, unfortunately at this time no one seems to have a resolution.  This is extremely frustrating as due to dataflows gen2 not being as parameterisable as data pipeline's, setting up initial data ingestion is very time consuming.

  • re84uk's avatar
    re84uk
    Helper I
    2 years ago

    Hi

     

    Do we know of any progress on this?  I have a support ticket logged with Microsoft however not really getting anywhere.