Dataset refresh with ADLS Gen2 failing

[Victor_V]

We are currently testing if we can migrate from our internal on-prem file storage towards a cloud based solution and chose Azure Blob Storage for this purpose, however we are still bumping into some issues regarding the refresh of some datasets in this regard.

We noticed that some of our larger datasets fail after about an hour of refresh with the following error message:

We're combining SAP HANA data with excel files in this particular case in which we connect to HANA through an on-prem gateway.

I tried looking online for some solutions and can confirm:

- The Power BI capacity & Azure Storage Account are on the same tenant.

- Refresh is working in Power BI Desktop.

- We can refresh smaller datasets that combine data from SAP HANA & ADLS Gen 2, so our on-premise gateway can access the files with the same credentials used.

- We are using OAuth to connect to the files. (SAS & Access tokens are not an option security wise)

We're looking for a possible explanation as to why this is happening.

Could it be that for example the access token that Power BI receives from the Azure Storage Account through OAuth is only valid for an hour and then expires?

[v-zhangti · Accepted solution]

Hi, @Victor_V 

The access token that Power BI receives from the Azure Storage Account through OAuth is indeed only valid for an hour and then expires. However, there are some ways to extend or refresh the token, depending on your authentication method and settings.

For example, if you are using app-only authentication, you can use a certificate or a client secret to obtain an access token that is not dependent on any user’s account. If you are using a shared access signature (SAS), you can edit the credential and sign in again to update the dataset credential.

powershell - Power BI: Extend expiration time of access token getting by Get-PowerBIAccessToken - St...

powerbi - Power Bi Azure Cost Management - oauth token - Stack Overflow

Best Regards,

Community Support Team _Charlotte

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[Victor_V]

Hey,

Thank you for the answer. Unfortunately OAuth is the only authentication method that we can use in this case else we go against our security model of the Storage Account.

Is there a way to increase the token lifetime that Power BI receives when it starts the refresh? Or make sure that a refresh token is send along to extend the lifetime in case it expires?

Thanks in advance!

Kind regards,

Victor V.

[lbendlin]

Could be.  Does the refresh work if you do NOT combine the sources?  Let the data model do that for you.