Forum Discussion

prasad08mm's avatar
prasad08mm
Frequent Visitor
4 years ago

Error in Gateway while data refreshing - There was an error when processing the data in the dataset

Hello All,

I am receiving an error in service for data refresh ( while doing On-demand and schedule refresh)

Error - There was an error when processing the data in the dataset.

Data Source error - {"error":{"code":"DM_GWPipeline_Client_ReceivedUncompressedDataExceedingLimit","pbi.error":{"code":"DM_GWPipeline_Client_ReceivedUncompressedDataExceedingLimit","parameters":{},"details":[],"exceptionCulprit":1}}}

The size of the pbix file is - 32MB

Data Records - 14.8 Million

I have SQL view as a source and on top of that in the power bi-power editor, we have unpivoted almost all the measures because of which the data exploded/multiple.

At desktop-level, the refresh works fine, with zero performance issues, and also when publishing it to services again no issue. But when we refresh the dataset in service I am receiving the above error.

One more thing we have implemented incremental policy/refresh because of the volume of data as it multiples, we have run in service for 2 months and it loaded the perfectly, however, we load for just 2 years it is throwing error.

Please guide. 

2 Replies

  • v-chenwuz-msft's avatar
    v-chenwuz-msft
    Community Support

    Hi prasad08mm ,

     

    I think the problem is some limitations cause this to happen. 

    Limit of 1 million rows returned on any query.

    Using DirectQuery in Power BI - Power BI | Microsoft Docs

     

    Maybe you can remove some visualizations or just let one page with one visualization and try refresh again.

     

    Best Regards

    Community Support Team _ chenwu zhu

     

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

     

  • Anonymous's avatar
    Anonymous
    Not applicable

    Did you find any solution on this issue? I am also facing the same issue.