Dataflow Refresh Error in Power BI Premium Per User Workspace

[NoorAlfar]

Hi,

I am experiencing an issue with a dataflow refresh in my Power BI Premium Per User workspace and would appreciate some insights or solutions.

During the refresh process, I received the following error: "Error: PipelineException: Array dimensions exceeded supported range." This error occurs when refreshing a specific data flow.

1. The dataflow involves pulling data from a database and applying some transformations
2. This dataflow feeds into another dataflow that contains historical data. The historical dataflow typically takes around 4 hours to refresh. However, I do not need to refresh this historical dataflow frequently
3. The new dataflow (the one experiencing the error) usually completes its refresh in about 4 minutes
   
   The error suggests a limitation related to array size during the processing stage.

Could anyone explain what might be causing this error and suggest potential solutions? 

[v-nuoc-msft · Accepted solution]

Hi @NoorAlfar 

Based on the error message you provided, it seems that the array dimension is out of support. This can be due to a document that is too large or a query that is too complex. This error is related to the . .NET architecture.

Here are some possible workarounds:

Divide the document into smaller chunks and process them separately. This has the potential to reduce memory consumption and array size during the refresh process.

Simplify the query or remove some unnecessary steps.

In some cases, updating a full copy of the source data with each refresh is time-consuming. You can consider incremental refresh.

You can view the link below for more details:

Using incremental refresh with dataflows - Power Query | Microsoft Learn

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.