Forum Discussion

BjoernSchaefer's avatar
7 years ago

Data Refreshes very slow

Hello everybody and a happy new year,

 

i'm dealing with a very serious issue right now. Since the November '18 Update of PowerBI Desktop the Data refreshes take very long. Database is a IBM DB2 that contains a table with ca. 2.5 million rows. 

The preview in powerquery works fine but it depends on wich transformation steps are added to the query. As soon as i click "Close and apply" i can leave my workstation for the rest of the day and when i return it's still running. And no, it's not loading rows, it's evaluating. When it's loading rows it feels like i can count with it. The refresh won't finish in the PowerBI Service because of a time out. I updated both PowerBI Desktop and the Gateway to the December '18 Version but it was useless. And i tried to fix that issue by deactivating Auto DateTime in the Settings.

Ironically, when i use the exact same query in Excel 2016 the 2.5 million rows are loaded within 10 - 20 seconds. Wich i really don't understand.

The system runs at 95 - 100% CPU-Usage, PowerBi Desktop creates three Mashup Evaluation Containers. I even deactivated the virus scan for testing.

 

Has anybody got the same or at least a similar problem?

 

Regards,

 

Bjoern

 

17 Replies

  • GTech01's avatar
    GTech01
    Frequent Visitor
    We have the exact same problem with DB2, another ODBC which connect to an ecclectic SQL database named HFSQL. Our analyst tells me he have the exact same problem with the mashup but not the service.
    • BjoernSchaefer's avatar
      BjoernSchaefer
      Helper II

      Hey there,

       

      thanks for the feedback. 

      Question(s):

      Are you using the native DB2-Connector in PowerBI? And wich Driver are you using? IBM or Microsoft? I'm using the Microsoft-Driver because i'm not able to get the IBM-Driver running. Wich always worked fine and really fast as well. 

       

      I quess this issue began with the release of DirectQuery for IBM DB2. Please treat this statement with caution, i'm still doing research on this but wasn't able to find any information.

       

      Regards

       

      Bjoern 

      • GTech01's avatar
        GTech01
        Frequent Visitor
        We use native DB2 with Microsoft driver because we never found a way to make the IBM one working. The Microsoft one was very fast until december release.
  • Anonymous's avatar
    Anonymous
    Not applicable

    Have you heard back yet? I am also noticing a slowdown recently of IBM DB2 connections that use the Microsoft Drivers . We are using import mode. The data refresh through Power BI Desktop takes significantly longer.

     

     

    Also, in the last week, the scheduled refresh for the connection started timing out as well with the following error: "Before the data import finished, its data source timed out. Double-check whether that data source can process import queries, and if it can, try again." I may need to cut down on the amount of data coming in to the dataset. We also migrated our enterprise gateway to a new server last week as well so it could be related to that, but has anyone also had this issue with IBM DB2 sources? The gateway connection says it is online. I know this is a desktop thread but I thought I would ask in cas anyone here saw this as well. Thanks!

    • Eric's avatar
      Eric
      Advocate I

      Was this issue every resolved?  We are having the same issue now.

      • BjoernSchaefer's avatar
        BjoernSchaefer
        Helper II

        Hi Eric,

        it isn't solved yet. My ticket is still open and the told me, that the Product Team is investigating that issue. ETA ist around end of April '19. We have to play the waiting game.

         

        Regards

         

        BjoernSchaefer