Forum Discussion

sjrrkb123's avatar
sjrrkb123
Helper III
4 years ago
Solved

Internal Dataflow Error on Power BI Dataset Refreh

I am posting here about a recent issue that has been popping causing dataset refresh failures. The error message includes an error called an "Internal Dataflow Error" as the cause of the refresh fail...
Need Help
v-easonf-msft's avatar
v-easonf-msft
Community Support
4 years ago

Hi, sjrrkb123 

I got similar feedback on this issue.

The cause of this issue is due to a known intermittent issue in Premium Gen2 workloads, including dataflows(ICM:297756751)

The issue is also listed in PowerBI Support forum.

https://powerbi.microsoft.com/en-us/support/

Known issue - Long running, failed or stuck dataflow in Premium Gen2 

The current advice is to change the workspace to PRO and back to Premium if the problem keeps occurring.

It is recommended to look into reducing the number of entities within a single dataflow .

 

Best Regards,
Community Support Team _ Eason

 

 

  • m-colbert's avatar
    m-colbert
    Resolver III
    4 years ago

    This is now happening to us. We were expeirncing random cancellations a few months back. But as of this morning, every single dataflow fails. This issue has been going on since January (per prior support call). Gen 2 has delivered problems, and none of the benefits. We are heavily invested in dataflow usage and I now need to rethink that strategy. The recommneded workarounds are not possibleand way to numerous to keep up with. Just fix it already or put it back that way it was.

    • sjrrkb123's avatar
      sjrrkb123
      Helper III
      4 years ago

      m-colbert we have been dealing with this since Gen2 upgrade in December 2021. We have had a ticket open with MSFT from March 2022 regarding this. The only current fix is to change the workspace containing the dataflows from Premium capacity to Pro, wait 10minutes, then switch back to Premium. This sometimes fixes it but not always and is the only known way to address the problem.

       

      According to MSFT, the fixes are coming in two waves, June 30 and July https://powerbi.microsoft.com/en-us/support/ 

      • m-colbert's avatar
        m-colbert
        Resolver III
        4 years ago

        @sjrrkb123

        Thanks for the reply. Our ticket is still open as well. I did see that notice this am when I checked for any service outtages. Got MS back on a call just now and magically it all started working again... figures. Was down for about 12 or so hours. Happy it's back though.

         

        Question for you, for the premium workspaces that you've downgraded to Pro and then assigned back to capacity, did this impact any dataflows with linked and/or computed entities? IOW, did downgrading lose some premium only settings?

         

        What about incremental refresh settings? I believe when you downgrade, it drops the partitions and forces a full refresh. Then assigning back to capacity you would need to restablish incremental settings, correct?

         

        For directquery to dataflows, do the reports using the dataflow stop working temporarily and then it's OK after putting back on capacity?

         

        I'm trying to establish what addtional work would come along with the downgrade, wait 10 min and reassign process. 

         

        Thanks again!