Forum Discussion
Schedule Refresh is failing - Data Source Credentials for the HTTP request response
- 1 year ago
Hi KR300
Thank you for reaching out to us on the Microsoft Fabric Community Forum.
We really apologize for the inconvenience, after reviewing the issue of schedule refresh is failing data source credentials for the HTTP request response, here are few steps to may resolve the issue.
- Make sure that all data source credentials are properly configured and authenticated in the Power BI Service.
- Verify that the HTTP request URL is accessible and returns the expected response. If the document hasn’t been published, consider implementing a way to handle 404 errors gracefully in your custom function.
- Adjust the custom function to manage 404 errors without causing the entire refresh to fail. You can return a default value or log the error for further analysis.
- If possible, isolate the HTTP request URL query from the other data sources to identify the issue more easily and prevent it from impacting the overall refresh process.
- The team utilizes additional data sources, including SharePoint Excel and other cloud services, for which the credentials have already been configured in the service. When attempting to enter credentials for the HTTP request URL, they encounter an error because the document has not been published, resulting in a 404 error.
Here is the link to the documentation that might assist in resolving the issue.
https://learn.microsoft.com/en-us/power-bi/connect-data/refresh-scheduled-refresh
If this post was helpful, please give us Kudos and consider marking Accept as solution to assist other members in finding it more easily.
Regards,
Menaka. - 1 year ago
Hi KR300 ,
We really apologies for the inconvenience.
Enable "Skip Test Connection" in Power BI Service. Since this HTTP request URL might not always be available, try skipping the test connection when setting up the credentials in Power BI Service:- Navigate to Power BI Service and go to the Dataset settings.
- Find the HTTP data source.
- Click on Edit credentials.
- Enable the option to Skip test connection.
- Save the changes and try the scheduled refresh again.
If the HTTP check is part of a larger dataset refresh, consider: - Separating the HTTP request into a standalone table that refreshes independently.
- Using dataflows to manage this step separately from other sources.
If this post was helpful, please give us Kudos and consider marking Accept as solution to assist other members in finding it more easily.
Regards,
Menaka.
Hi KR300 ,
Skipping the test connection only impacts credential validation during setup and does not affect data retrieval during scheduled refreshes. Once the document becomes available, Power BI Service will successfully access it in the next scheduled refresh, fetch the latest data, and update the report.
The HTTP request is part of your main dataset refresh, causing the entire refresh to fail when the document is not available. Separating it into a standalone table means,creating a new table in Power Query dedicated to fetching the HTTP status of the document.Refreshing this table separately from the main dataset.
It can be done like below:
- Create a separate Power Query table for the HTTP request response.
- Load it into Power BI as a separate table ,do not merge it with the main dataset.
- Schedule the refresh for this table independently, so it does not interfere with other datasets.
By doing this, even if the HTTP request fails , it won’t impact the rest of the report refresh.
Yes, using Dataflows can help manage this step separately. Here’s how:
- Create a Dataflow in Power BI Service that only contains the HTTP request query.
- Schedule the Dataflow to refresh separately
- In Power BI Desktop, connect your main dataset to this Dataflow instead of making direct HTTP requests.
- Since the Dataflow refreshes independently, if the HTTP request fails, it won’t affect the main dataset refresh.
- The main dataset will simply fetch the latest successful result from the Dataflow without failing.
If this post was helpful, please give us Kudos and consider marking Accept as solution to assist other members in finding it more easily.
Regards,
Menaka.
Hi KR300 ,
I hope this information is helpful. Please let me know if you have any further questions or if you'd like to discuss this further. If this answers your question, please Accept it as a solution and give it a 'Kudos' so others can find it easily.
Thank you.