Refresh time conflict in power bi desktop and power bi service.

[Ayyappa5678]

Hi Team,

Kindly help me below issue.

In power bi desktop all the tables refreshing sucessfully with in 1-2 mins, but in power bi service taken 40 mins to refresh successfully, It is refreshing through on-premises gateway, and the data source is ADLS Gen2.

What is the issue? and how to fix in power bi service?

Sometimes refresh failed and sometimes refresh completed successfully, if failed getting below error, all the gateway connection credentials all are correct. 

{"error":{"code":"DM_GWPipeline_Gateway_InvalidConnectionCredentials","pbi.error":{"code":"DM_GWPipeline_Gateway_InvalidConnectionCredentials","parameters":{},"details":[{"code":"DM_ErrorDetailNameCode_UnderlyingErrorCode","detail":{"type":1,"value":"-2147467259"}},{"code":"DM_ErrorDetailNameCode_UnderlyingErrorMessage","detail":{"type":1,"value":"The credentials provided for the AzureDataLakeStorage source are invalid. (Source at YOUR DATA SOURCE PATH.)"}},{"code":"DM_ErrorDetailNameCode_UnderlyingHResult","detail":{"type":1,"value":"-2147467259"}},...YOUR DATA SOURCE PATH"}},{"code":"Microsoft.Data.Mashup.CredentialError.Reason","detail":{"type":1,"...

[Akash_Varuna · Accepted solution]

Hi @Ayyappa5678 , In PBI Service it might take some time as it is connected through GateWay could you check these out please 

• Gateway Configuration:

  • Update the On-Premises Data Gateway to the latest version.
  • Re-enter credentials in Manage Gateways in Power BI Service.

• Optimize Refresh:

  • Use Incremental Refresh to limit data refresh.
  • Ensure Query Folding is applied to transformations.
  • Partition data in ADLS  for better performance.
    To reduce gateway load you could also try to schedule refresh during off peak hours
    If this post helped please do give a kudos and accept this as a solution
    Thanks In Advance

[anshusengh]

Hi team,
I am also facing same error, whereas my credentials for gateway is correct and as my dataset is a very large on I ahve applied inc refresh too. But still I am facing same error. If the credentials were wrong it should not get refreshed any time, but I am able to refresh it 4 out of 7 times a week, for rest 3 I get same issue of invalid credentials. I am using Snowflake as datasource.
Can someone please help?

[v-achippa]

Hi @Ayyappa5678,

Thank you for reaching out to Microsoft Fabric Community.

Thank you @tharunkumarRTK and @Akash_Varuna for addressing the issue.

As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided by the super user resolved your issue? or let us know if you need any further assistance.
If our super user response resolved your issue, please mark it as "Accept as solution" and click "Yes" if you found it helpful.

Thanks and regards,

Anjan Kumar Chippa

[v-achippa]

Hi @Ayyappa5678,

We wanted to kindly follow up to check if the solution provided by the super user resolved your issue.
If our super user response resolved your issue, please mark it as "Accept as solution" and click "Yes" if you found it helpful.

Thanks and regards,

Anjan Kumar Chippa

[v-achippa]

Hi @FatimaArshad,

As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided by the super user resolved your issue.
If our super user response resolved your issue, please mark it as "Accept as solution" and click "Yes" if you found it helpful.

Thanks and regards,

Anjan Kumar Chippa

[tharunkumarRTK · Accepted solution]

@Ayyappa5678 

The refresh failure error message clearly indicates that the credentails you supplied are incorrect, so please update the gateway connection with the correct credentails.

Regarding the longer refresh duration, it depends on several factors, consider the datasource is ADLS and you are refreshing it through on premises gateway connection,

1. please check the load on the gateway. Or try to refresh the report during off hours and check the duration. If it is due to high load on the gateway server then you need to increse the number of nodes in the gateway cluster

2. Check the network route between the gateway server and the ADLS storage endpoint, connect with your network team and if it is taking longer route than expected then you need to change the network routing table.

3. You can also visualize the refrehs by capturing the power bi event traces 

https://dax.tips/2021/02/15/visualise-your-power-bi-refresh/

this will help you to understand which operation is taking significant time

Need a Power BI Consultation? Hire me on Upwork

Connect on LinkedIn

Did I answer your question? Mark my post as a solution!
If I helped you, click on the Thumbs Up to give Kudos. Proud to be a Super User!

[Akash_Varuna · Accepted solution]

Hi @Ayyappa5678 , In PBI Service it might take some time as it is connected through GateWay could you check these out please 

• Gateway Configuration:

  • Update the On-Premises Data Gateway to the latest version.
  • Re-enter credentials in Manage Gateways in Power BI Service.

• Optimize Refresh:

  • Use Incremental Refresh to limit data refresh.
  • Ensure Query Folding is applied to transformations.
  • Partition data in ADLS  for better performance.
    To reduce gateway load you could also try to schedule refresh during off peak hours
    If this post helped please do give a kudos and accept this as a solution
    Thanks In Advance