Forum Discussion
Refresh error
Hi HaiVN ,
Thank you for reaching out to Microsoft Fabric Community.
Thank you ibarrau for the prompt response. Refreshing a report from the service with data directly from the web versus using a dataflow can have different implications due to the way data is handled and processed.
- When you refresh a report that gets data directly from the web, the service needs to connect to the web source each time to fetch the latest data. This can be challenging due to various factors such as network latency, data source availability, and the complexity of the data transformations required. If the web source is slow or unreliable, it can cause the refresh process to fail or take a long time.
- Dataflows are designed to handle data extraction, transformation, and loading (ETL) processes efficiently. When you use a dataflow, the heavy lifting of data transformations is done upstream, and the data is stored in a structured format that is optimized for quick retrieval. This means that when you refresh a report that uses data from a dataflow, the service can quickly access the pre-processed data, making the refresh process more reliable and faster.
Here are some general steps to solve the issue :
- When you connect directly to a web data source using Web.Contents(),ensure that the data source credentials are correctly configured in the Power BI Service. Navigate to the dataset settings and look for Data Source Credentials. Edit and update them if necessary.If there are any issues with the credentials, the refresh might fail.
- If you are using direct web connections, consider installing and configuring an on-premises data gateway. This will act as a bridge between Power BI Service and the web data source.
- Since dataflows are working well for refreshing data in the service, consider using dataflows for all web data sources. This approach can help manage and transform the data before it reaches the Power BI report, ensuring reliable refreshes.
- Check for any network restrictions or security settings that might be blocking the connection from Power BI Service to the web data source. Ensure that the website is accessible from the Power BI Service environment.
If this post helps, then please consider Accepting as solution to help the other members find it more quickly, don't forget to give a "Kudos" – I’d truly appreciate it!
Regards,
Rama U.
- When you refresh a report that gets data directly from the web, the service needs to connect to the web source each time to fetch the latest data. This can be challenging due to various factors such as network latency, data source availability, and the complexity of the data transformations required. If the web source is slow or unreliable, it can cause the refresh process to fail or take a long time.
Hi. As you can see at the code, inside csv.document you have a web.contents. You can just go to the semantic model settings, look for Data Source Credentials and expand de menu to edit them. If you don't have any other source in the model, that would be enough to schedule a refresh without a gateway. If you have more sources it will depend on them too.
I hope that make sense
ibarrau
Thanh you for helps!
1- I try to make a dataflow for data set ( via the website) and Power BI repport get data via this dataflow. It works well with both Power BI desktop and Power BI service. I mean I can refresh the semantic model i service or refresh the Power BI desktop repport.
2- If I get data direct from website ( not via dataflow) , it works for only Power BI desktop. I could not refresh the repport when it is published i Power service.
I do not know what is the difference between 1 & 2?
I think I'm missing the point here. Do you want to know differences about using dataflow vs power bi desktop semantic model? (theorically speaking), if so let me know.
I'll try to recap what you can do.
You can get data from source using power bi desktop (that will generate a semantic model + report). You can also get data from source using dataflow gen1 and then get data from dataflow using power bi desktop.
The desktop should be publish to service in order to share. Once in service you can configure refreshes for Dataflows or Semantic models. Both of them should have a "schedule refresh" setting. When you open it, it will show what you need to make it refresh at service. When the data is at cloud, like the example of the csv, you just need to expand data source credentials and edit them.
Regards
ibarrau
Hei,
I mean why I cannot refresh from service with report wich gets data direct from the web. But, I can refresh the reppot i service if data is getting via dataflow?
THank you!Hi HaiVN ,
Thank you for reaching out to Microsoft Fabric Community.
Thank you ibarrau for the prompt response. Refreshing a report from the service with data directly from the web versus using a dataflow can have different implications due to the way data is handled and processed.
- When you refresh a report that gets data directly from the web, the service needs to connect to the web source each time to fetch the latest data. This can be challenging due to various factors such as network latency, data source availability, and the complexity of the data transformations required. If the web source is slow or unreliable, it can cause the refresh process to fail or take a long time.
- Dataflows are designed to handle data extraction, transformation, and loading (ETL) processes efficiently. When you use a dataflow, the heavy lifting of data transformations is done upstream, and the data is stored in a structured format that is optimized for quick retrieval. This means that when you refresh a report that uses data from a dataflow, the service can quickly access the pre-processed data, making the refresh process more reliable and faster.
Here are some general steps to solve the issue :
- When you connect directly to a web data source using Web.Contents(),ensure that the data source credentials are correctly configured in the Power BI Service. Navigate to the dataset settings and look for Data Source Credentials. Edit and update them if necessary.If there are any issues with the credentials, the refresh might fail.
- If you are using direct web connections, consider installing and configuring an on-premises data gateway. This will act as a bridge between Power BI Service and the web data source.
- Since dataflows are working well for refreshing data in the service, consider using dataflows for all web data sources. This approach can help manage and transform the data before it reaches the Power BI report, ensuring reliable refreshes.
- Check for any network restrictions or security settings that might be blocking the connection from Power BI Service to the web data source. Ensure that the website is accessible from the Power BI Service environment.
If this post helps, then please consider Accepting as solution to help the other members find it more quickly, don't forget to give a "Kudos" – I’d truly appreciate it!
Regards,
Rama U.
- When you refresh a report that gets data directly from the web, the service needs to connect to the web source each time to fetch the latest data. This can be challenging due to various factors such as network latency, data source availability, and the complexity of the data transformations required. If the web source is slow or unreliable, it can cause the refresh process to fail or take a long time.