Power BI Desktop doesn't load all the data from Dataflow

[sashaxp]

Started to realize that not all data exist in some of my reports and after investigation It turns out that while data exist in dataflow (checked by filtering out data that missing in reports), it doesn't loaded into Power BI desktop after refreshing corresponding table. Looks like this problem started to happen recently as missing data is data that is recently added. What makes me really frustrated is that this happened silently, no errors, nothing.

[parry2k]

@sashaxp indeed it is, never seen this. I do a lot of work for my customers where dataflow is used extensively and never seen this. Basically, the refresh is not writing the data to the destination, completely strange. If I were you, I would open a ticket to figure out what is going on while moving forward with using the duplicate table. 

👉 Learn Power BI and Fabric - subscribe to our YT channel - @PowerBIHowTo

[sashaxp]

Opened the ticked. Will post back as soon as we find out what was the root cause of that behavior.

[sashaxp · Accepted solution]

So it turns out that clearing up datasource credentials and then authenticating again fixed an issue however we do not understand why it is happened, and also why there is no errors comes up. Trying to identify root cause with msft support. 

[Spegkas]

Hello,
It happened to us yesterday, do you mean clearing credentials in power bi desktop?

[sashaxp]

Absolutely strange behavior, no errors and no power query is empty on power bi desktop side except getting data from dataflow. To investigate situation further I've duplicated table in the dataflow that has missing data after loading into power bi desktop. Added this duplicated table into power bi desktop, no problem, no data missed. While refreshing original table in desktop do not lead to the same result.  

[parry2k]

@sashaxp This is strange, refresh is successful, with no error, correct? I assume there is no filter in Power Query when you are pulling the data. Trying to look into potential issues.

👉 Learn Power BI and Fabric - subscribe to our YT channel - @PowerBIHowTo

[vaibhavkale570]

I understand your frustration. Silent data issues in Power BI can be challenging to identify and resolve. There could be several reasons why the data is not loading into Power BI Desktop after refreshing the corresponding table. Here are some potential causes and troubleshooting steps:

1. Data Source Configuration: Double-check the data source configuration in Power BI Desktop to ensure it is pointing to the correct location and credentials are up-to-date.

2. Query Editor Steps: Verify the applied transformations in the Query Editor to ensure that data filtering or manipulation is not inadvertently excluding the missing data.

3. Refresh Errors: Although you mentioned there were no errors, it's still worth checking the refresh history and logs to see if there were any issues or warnings during the refresh process.

4. Data Model Relationships: Make sure the relationships between tables are correctly defined. If there are issues with the relationships, data might not appear as expected.

5. Data Load Settings: Check the data load settings in Power BI Desktop to see if there are any filters or restrictions that might be causing the data not to load.

6. Column Data Types: Ensure that the data types of the columns in your data source match the data types in the Power BI data model. Mismatched data types can cause data not to load correctly.

7. Partitioning: If you're using data partitioning in your dataflow, check if the partitions are set up correctly and if the missing data falls within the specified partition range.

8. Dataflow Refresh: Verify if the dataflow itself is refreshing successfully. It's possible that the data is present in the dataflow, but the dataflow itself is not updating.

9. Cache and Query Folding: Power BI might be using cached data or applying query folding, which could lead to incomplete data. Try clearing the cache and disabling query folding to see if that resolves the issue.

10. Power Query Formula Errors: Review the Power Query formulas in your dataflow to ensure there are no errors or issues that might be causing the data not to load properly.

11. Date and Timezone Considerations: Check if there are any date or timezone-related issues that might be affecting the data filtering or loading process.

12. Power BI Version: Ensure that you are using the latest version of Power BI Desktop to take advantage of any bug fixes or improvements.

[parry2k]

@sashaxp if you filtered the data in dataflow and see it there that doesn't mean data is available for Power BI. Make sure you refresh the dataflow and then check in the Power BI desktop.

👉 Learn Power BI and Fabric - subscribe to our YT channel - @PowerBIHowTo

[sashaxp]

This dataflow refreshes daily and data that is missed should be there for couple of weeks for sure. Anyway proactively refreshed dataflow, then refreshed in Power BI Desktop, still missing.