Forum Discussion

motoray's avatar
motoray
Advocate V
3 years ago

Gen2 Dataflow failures when loading medium sized datasets

I've been trying to get a medium-sized (100,000 records for now) dataset to load from a SQL database (on prem and Azure) to a Fabric Warehouse from a Gen2 dataflow. I can get it to load 1000 or 10000...
Dataflows
Need Help
motoray's avatar
motoray
Advocate V
3 years ago

Now none of my Gen2 dataflows will complete so I'm not sure what's going on anymore. Time to call in Microsoft.

motoray's avatar
motoray
Advocate V
3 years ago

And as of right now, I still can't get any Gen2 dataflows to complete--not since last Thursday around 1 pm PST. Something is hard broken now. Have built new workspaces, lakehouse, dataflows...nothing works. The refreshes simply spin on forever now.

  • miguel's avatar
    miguel
    Community Admin
    3 years ago

    Hey!

    Could you please share a screenshot of the error message that you're seeing inside of the refresh history dialog?

    • ShunOshidari's avatar
      ShunOshidari
      Helper I
      3 years ago

      Thank you for taking a look.

       

      We will share the screenshots of our error screens.

      Since the error message is identical to what motoray posted, we believe our situation is similar to motoray's.

       

       

    • SidJay's avatar
      SidJay
      Microsoft Employee
      3 years ago

      Hi motoray,

       

      If you could please also paste the Request ID for some of your failed dataflow refreshes that would be appreciated.

       

      There are some known ongoing issues with SQL endpoints and we would like to see whether you are impacted by those or encountering separate issues.

       

      Thanks

      • motoray's avatar
        motoray
        Advocate V
        3 years ago

        Here are some request IDs:

        30ea6d08-cd77-439d-b094-1c3a9c3222ca

        a103dcc1-d9cd-4f20-9848-539af2c6be68

        cc31824d-9766-4dac-8c66-affda2fe69ce

        e8ac09a0-f667-4f88-a3bf-c94a531b2827

        9db665b1-3ea9-4ee0-a9c6-ec2133fe5227

        d4f414ea-8f21-4bde-8130-9155dcc3f1f2

        6751049f-79ff-44ae-9bca-3cab134cbcf6

        c7eca806-2a1f-4443-b040-7811607935d9

    • motoray's avatar
      motoray
      Advocate V
      3 years ago

      Here are a couple of screenshots--same message, different dataflows and requests.