Stream update without error but without data loading

[Syndicate_Admin]

Good morning.

For a few weeks now, (approximately mid-December) this has been happening to me:

I have flows in a Premium per User workspace with 4 daily scheduled updates each. Once updated, I have the dataset refreshes scheduled as well to update the PBI reports. Until that date it worked perfectly.

Now it happens that not giving an error and running the updates, they do not load the new data that comes from excels where they dump Office 365 forms.

I have even tried a daily update automation with Power Automate, which does not give an error either, but the same thing happens.

The only solution is to update manually and that case does load the data.

Can someone help me find out why and be able to automate it so that it works?

Thank you.

[Ritaf1983]

Hi @Syndicate_Admin 

This is a topic that's difficult to assist with without access to the data, so here are a few things you can debug to help resolve the issue:

1. Check Data Source Permissions:
   Ensure the credentials used for the scheduled refresh (in Power BI Service or Power Automate) have the necessary permissions to access the Excel files. Manual refresh often uses the currently logged-in user's credentials, which might differ from the credentials stored in the service.

2. Refresh in Power BI Service:

   • Verify the credentials in "Data Source Settings" in Power BI Service. Re-enter them if necessary.
   • Ensure the dataset is configured to refresh on the same schedule as the flow. If there’s a delay between the data update and the dataset refresh, new data might not appear.

3. Power Automate Configuration:

   • Double-check your Power Automate flow to ensure it runs after the Excel files are updated.
   • Add a delay or retry step in the flow to allow for potential delays in file updates.

4. Caching Issue:
   Sometimes, automated refresh might be impacted by caching.

   • Try clearing the query cache in Power BI Service or ensuring the query settings are set to fetch the latest data.

5. Compare Automated vs. Manual Refresh:
   If manual refresh works but automated refresh doesn’t, it’s likely due to a difference in how the refresh process is triggered or credentials are handled. Confirm that the same query is being executed in both cases.

6. Office 365 Files Update Timing:
   If the Excel files are being updated by a process (e.g., forms or automation), ensure there’s enough time between the file update and the scheduled refresh to allow Power BI to detect and load the changes.

7. Logs and Monitoring:
   Check the refresh history logs in Power BI Service. Even if there’s no error, the logs might provide clues, such as skipped steps or stale data loading.

8. Test Automation with Manual Trigger:
   Instead of relying on a scheduled refresh, try triggering the refresh manually via Power Automate to see if it behaves differently. This can help identify whether the issue is with the schedule or the automation process.

If none of these steps resolve the issue, it could be a service-specific problem, and contacting Microsoft support might be necessary.

https://community.fabric.microsoft.com/t5/Power-BI-Community-Blog/How-to-create-a-support-ticket-in-...

If this post helps, then please consider Accepting it as the solution to help the other members find it more quickly.

[Syndicate_Admin]

Good morning.

I have checked and verified step by step what you recommend.
There is only one thing that I cannot verify and that is the clearing of the Power Bi Service query cache. Can you please help me? I can't find a way to do it. I understand that this deletion would affect the entire service used in the company, not just my workflows.
Again, the problem happens in flows made in power query in the Power Bi service. The data source is excels. I've checked even past the weekend with several scheduled updates plus several updates made with Power Automate and it still doesn't reflect the new data. I have to do the purely manual update for it to take effect.
Can this have to do with the problems that the Office 365 service has been giving since mid-December, apparently due to Microsoft problems that have not yet been solved?

Thank you

[Syndicate_Admin]

It seems that it is caused because Microsoft now forces you to enter the excel file so that it synchronizes with the form. I do not understand the objective of this measure, since processes that we had automated now force us to start again, for example dumping in sharepoint lists or manually entering each of the excel files (a ridiculous task that makes us lose a lot of time). I'm wondering if there's a way through Power Automate to force the sync of the excel where you dump the form.

[Anonymous]

Hi @Syndicate_Admin 

Did the solution Ritaf1983  offered help you solve the problem, if it helps you can consider to accept it as a solution so that more user can refer to.

Best Regards!

Yolo Zhu