Power BI refresh failed multiples times, and it got automatically fixed after few refreshes.

[SaiPrakash]

Hi There,

I am seeing a refresh failure in power bi service for many reports we are working on. It says that it is an internal service error and a transient issue. Can anyone let me know why is the refresh failure happening based on the below error code. This error occured multiples in back to back refreshes and fixed automatically after that. Please help me find a root cause for this refresh error.

Refresh failed:
TEST report has failed to refresh.
Failure details: The last refresh attempt failed because of an internal service error. This is usually a transient issue. If you try again later and still see this message, contact support.

<ccon>DataSource.Error: ODBC: ERROR [58030] [Microsoft][Hardy] (35) Error from server: error code: '0' error message: 'org.apache.hive.service.cli.HiveSQLException: Error running query: [UNABLE_TO_FETCH_HIVE_TABLES] org.apache.spark.SparkException: [UNABLE_TO_FETCH_HIVE_TABLES] Unable to fetch tables of Hive database: pfna_sem_glbl. Error Class Name: org.apache.hadoop.hive.metastore.api.MetaException. SQLSTATE: 58030 at org.apache.spark.sql.hive.thriftserver.HiveThriftServerErrors$.runningQueryError(HiveThriftServerErrors.scala:49) at org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.$anonfun$execute$1(SparkExecuteStatementOperation.scala:929) at scala.runtime.java8.JFunction0$mcV$sp.apply(JFunction0$mcV$sp.java:23) at com.databricks.unity.UCSEphemeralState$Handle.runWith(UCSEphemeralState.scala:51) at com.databricks.unity.HandleImpl.runWith(UCSHandle.scala:104) at org.apache.spark.sql.hive.thriftserver.SparkExecuteStatementOperation.org$apache$spark$sql$hive$thriftserver$SparkExecuteStatementOperation$$execut.... Microsoft.Data.Mashup.ErrorCode = 10478. DataSourceKind = Databricks. DataSourcePath = {"host":"adb-4435214167692548.8.azuredatabricks.net","httpPath":"\/sql\/1.0\/warehouses\/422e43d7899c910c"}. OdbcErrors = #table({"SQLState", "NativeError", "Message"}, {}). </ccon>. The exception was raised by the IDbCommand interface. Table: Reg_status.

[v-kpoloju-msft · Accepted solution]

Hi @SaiPrakash,

Thank you for reaching out to the Microsoft fabric community forum. Thank you @bhanu_gautam, for your inputs on this issue.

Based on the error message and code, the refresh failures are due to a transient internal service error in the Databricks Hive Metastore, which Power BI relies on when connecting to your dataset.

This typically happens when:

• The Databricks SQL warehouse is starting up (cold start)
• There is temporary unavailability or load on the Hive Metastore
• Power BI is trying to fetch Hive metadata (table info) and it times out or fails due to high resource demand

Since this resolved automatically after a few retries, it points to a transient condition. However, to reduce future occurrences:

• Make sure the SQL warehouse is pre-warmed or kept running before scheduled refreshes
• Prefer using direct SQL queries in Power BI instead of navigating through tables (which triggers Hive metadata calls)
• Stagger refresh schedules to reduce simultaneous load across datasets
• Ensure the Databricks ODBC driver is up to date (if a gateway is involved)

Kindly refer to the below link for better understanding:
Troubleshoot refresh scenarios - Power BI | Microsoft Learn

If this post helps, then please give us ‘Kudos’ and consider Accept it as a solution to help the other members find it more quickly.

Thank you for using Microsoft Community Forum.

[v-kpoloju-msft]

Hi @SaiPrakash,

May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.

Thank you.

[v-kpoloju-msft]

Hi @SaiPrakash,

I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If my response has addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.

Thank you.

[v-kpoloju-msft]

Hi @SaiPrakash,

I hope this information is helpful. Please let me know if you have any further questions or if you'd like to discuss this further. If this answers your question, please Accept it as a solution and give it a 'Kudos' so others can find it easily.

Thank you.

[bhanu_gautam]

@SaiPrakash The error message you are encountering indicates that the refresh failure in Power BI is due to an internal service error related to the Databricks data source. Specifically, the error is caused by an issue with fetching Hive tables from the Hive database pfna_sem_glbl. The error class name org.apache.hadoop.hive.metastore.api.MetaException suggests that there is a problem with the Hive metastore, which is responsible for managing the metadata of Hive tables.

Ensure that the Databricks cluster is running smoothly and has sufficient resources (CPU, memory) to handle the queries.