Forum Discussion

chiburi's avatar
chiburi
Regular Visitor
8 years ago

Spark Connector Scheduled Refresh Failing

I've been POC'ing loading data from Spark into power BI.

 

All was going fine until I started load testing the scheduled refresh in the power service and I'm hitting lots of different intermittant issues. I've had various errors and can't seem to establish 1) a pattern 2) a cause and 3) a solution.

 

I've tried upping the cluster size and memory to no avail. Anyone got any ideas?

 

Errors that have occured intermintantly i.e. sometimes it succeeds:

  • ODBC: ERROR [HY000] [Microsoft][Hardy] (34) Error from server: Could not refill buffer. Table: ******* 
  • ODBC: ERROR [HY000] [Microsoft][Hardy] (34) Error from server: Invalid method name: 'GetPrimaryKeys'. Table: *********
  • The table has no visible columns and cannot be queried. Table: *****

I get this sometimes also...

  • Last refresh succeeded: null

The connection driver seems really flakey!

8 Replies

    • chiburi's avatar
      chiburi
      Regular Visitor
      8 years ago

      Hi.

       

      I know what fiddler is but how are you expecting me to get further detail using it?

      This is all Cloud Azure - powerbi app service is reshreshing against databricks spark cluster PaaS service.

       

      Thanks

      • Anonymous's avatar
        Anonymous
        Not applicable
        8 years ago

        HI chiburi,

         

        >>I know what fiddler is but how are you expecting me to get further detail using it?

        Please trace some logs for refresh operation.

         

        Actually, I want to confirm if your issue is same as one support ticket which other user submitted.

         

        BTW, azure has canceled spark subscription, I guess your issue may related to it.

         

        Regards,

        Xiaoxin Sheng