Data Stopped Refreshing

[BossHogg]

We have a connection with VSTS and sometime in early July there was a change that now causes our data refresh to timeout. Our system did not grow that large to where it should timeout. One of the reports was a report that suddenly started failing in July.

We couldn't import data from Visual Studio Team Services

There was an error when processing the data in the dataset.
Please try again later or contact support. If you contact support, please provide these details.

Data source type

Processing errorTimeout expired. The timeout period elapsed prior to completion of the operation.

Correlation IDe6bf830d-a3c0-a51c-f178-bd5304555e94

Activity ID56ff09b9-caf4-d8fc-89ea-5407c2fe0bdd

Request ID6d1f7ac8-872a-6417-4daa-1b4dad2348d0

Status code400

TimeMon Jul 24 2017 16:47:42 GMT-0500 (Central Daylight Time)

Version13.0.1930.145

Cluster URIhttps://wabi-south-central-us-redirect.analysis.windows.net

_____________________________________________

There was an error when processing the data in the dataset.
Please try again later or contact support. If you contact support, please provide these details.

Processing errorThe XML for Analysis request timed out before it was completed. Timeout value: 7200 sec. The current operation was cancelled because another operation in the transaction failed.

Cluster URIWABI-SOUTH-CENTRAL-US-redirect.analysis.windows.net

Activity ID6b6d8fda-19ea-4354-a12d-f4cb58995d4f

Request ID3aa16397-b105-42b5-9f9c-9a0ff34b7266

Time2017-07-22 16:39:00Z

[v-haibl-msft]

@BossHogg

I got some information from the related team.

The VSTS Content pack is based on VSTS REST API’s. Calls to those API’s were causing accounts to be throttled and introducing a lot of load on the service so we introduced a delay into the calls. Introducing the delay has caused some accounts to hit the timeout for data refresh in Power BI.com which is why the customers data set went from working properly to failing unexpectedly. 

We are working on a new OData endpoint tied to the new Analytics Marketplace extension (https://marketplace.visualstudio.com/items?itemName=ms.vss-analytics). The OData feed is currently based on WIT but will grow to support all data types. The OData endpoint is designed to address many of the problems with the content pack today but unfortunately the preview of the WIT OData endpoint is closed.

If you send me the customers VSTS Account URL, I can send it to related team and they will add it to the preview as soon as it becomes available.

Best Regards,
Herbert

[BossHogg]

This presents a problem for us because we switched over to VSTS from TFS with the understanding that Power Bi will be the replacement for the excel spreadsheets since the previous tie in is not available for VSTS. What is the work around?

[BossHogg]

 Where do you want me to send the URL to? 

[v-haibl-msft]

@BossHogg

You can send me through private message and then I will send it to related team.

Best Regards,
Herbert

[v-haibl-msft]

@BossHogg

I've mailed your account to the related team. I'll update here once I get any reply.

Best Regards,
Herbert

[v-haibl-msft]

@BossHogg

I’ve got response from the related Team.

We did introduce a change to the way the VSTS Content Pack queries the REST APIs to prevent it from throttling VSTS on our largest accounts. If the data refresh is timing out on the content pack the primary alternative is using the Analytics OData endpoint. The preview for OData is currently closed but because the customer is blocked from using the Content Pack we will make an exception.

To start using the 3 new Widgets and OData the customer will need to install the Analytics Extension on the account - https://marketplace.visualstudio.com/items?itemName=ms.vss-analytics.

Examples of how to use the Power BI extension (VSTS.Feed) can be found here: https://www.visualstudio.com/en-us/docs/report/powerbi/data-connector-functions

A general overview of the OData endpoint can be found here: https://www.visualstudio.com/en-us/docs/report/analytics/overview-analytics-service

A more detailed overview of the aggregations we support can be found here: https://www.visualstudio.com/en-us/docs/report/analytics/aggregated-data-analytics.

We are working on some experiences which will improve the out of the box functionality with our OData endpoint and Power BI which is currently planned for early next year.  We do not have any plans to update the Content Pack at this time.

Best Regards,
Herbert

[Dhanabalan0292]

Hi I got the similar Error error: The XML for Analysis request timed out before it was completed. Timeout value: 7200 sec. Cluster URI: WABI-NORTH-EUROPE-L-PRIMARY-redirect.analysis.windows.net Duration 2h 0m 8s Failed I have a Power BI report connected to a table with approximately 8 million records, which has been refreshing successfully on a daily schedule. Recently, the scheduled auto-refresh has started failing with an error, even though the same report refreshes without any issues in Power BI Desktop. Publishing the report to the Power BI Service also works without errors. Notably, this issue only occurs during the scheduled refresh, despite using a Pro license.