Forum Discussion
Missing Data in Power BI Report – Discrepancy Between Databricks and Power BI
Hi everyone,
I'm experiencing an issue where my Power BI report does not fully load all data. I had this issue a few weeks ago, but it resolved itself. However, it has returned yesterday and today.
When I run a simple COUNT(*) statement directly on my Databricks SQL Warehouse, I get almost 7 million more rows than what Power BI loads. This issue occurs in both Power BI Desktop and Power BI Service refreshes.
Setup:
Data source: Databricks SQL Warehouse
Issue: Missing rows when loading data into Power BI
I've come across older forum posts describing similar issues (though with different data sources), so I’m wondering:
Is this a known or ongoing issue with Power BI and Databricks?
What can I do to ensure Power BI loads all data correctly?
Things i have tried sofar with no results:
- Going back to an older version of Power BI - Jan 2025
- Loading the table in a new Power BI report
- Asking a collegue to refresh the dataset to see if it was my laptop
- Loading the tables 1 by 1
Any insights or troubleshooting steps would be greatly appreciated!
Thanks in advance!
Hi anna_koeman ,
Thank you for engaging with the Microsoft Fabric Community. Here are a few things you can check.
1. Ensure no filters or transformations are removing rows unexpectedly.
2. Verify the Native Query Right-click the final step, select View Native Query, and run it directly in Databricks to compare row counts.
3. Use the Correct Connector Make sure you’re using the official Azure Databricks connector, not ODBC or generic SQL, as these may have limitations.
4. Table Partitions Issue If your table is in Delta Lake, Power BI might not be reading all partitions.
If my response solved your query, please mark it as the Accepted solution to help others find it easily.
And if my answer was helpful, I'd really appreciate a 'Kudos'.
3 Replies
What are you doing in powerquery? Can you share the script?
Hi anna_koeman ,
Thank you for engaging with the Microsoft Fabric Community. Here are a few things you can check.
1. Ensure no filters or transformations are removing rows unexpectedly.
2. Verify the Native Query Right-click the final step, select View Native Query, and run it directly in Databricks to compare row counts.
3. Use the Correct Connector Make sure you’re using the official Azure Databricks connector, not ODBC or generic SQL, as these may have limitations.
4. Table Partitions Issue If your table is in Delta Lake, Power BI might not be reading all partitions.
If my response solved your query, please mark it as the Accepted solution to help others find it easily.
And if my answer was helpful, I'd really appreciate a 'Kudos'.
Hi anna_koeman ,
May I ask if you have resolved this issue? If so, please mark the helpful reply and accept it as the solution. This will be helpful for other community members who have similar problems to solve it faster.
Thank you.
