Scheduled refresh failed : There was an error when processing the data in the dataset.

[albertoserinf]

When trying to update dataset in Power BI service by using the scheduled data refresh via the gateway I got this error message

The pbix file has been created with Power BI Desktop and the datasource is an on-premise SQL server database.

Thanks for your hints.

Regards

Alberto

[v-yuezhe-msft]

@albertoserinf,

The above error message points to Pick_fact_revenues table. Are you able to refresh the data when you open report in Power BI Desktop? And have you checked if there are any issues with Pick_fact_revenues  table in Power BI Desktop?

Regards,
Lydia

[albertoserinf]

Good morning Lydia

Yes, we are able to refresh data within Power BI Desktop.

We found out that the problem is linked to the size of the Pick_fact_reveneus table within the SQL database we connected to the datamodel.

Since this table is bigger than 10GB,  the uncompressed data received by the data gateway client exceeds the limit admitted for Power BI Pro.

Now my question is:

let's say that we find out a way within Power BI Desktop to reduce the amount of data we import from this table, but the size of this table reamains the same in the source database (bigger than 10GB).

What happens when we try to schedule a data refresh by using the data gateway? Does this limit still exist? 

Thanks @v-yuezhe-msft for your reply.

Regards

Alberto

[v-yuezhe-msft]

@albertoserinf,

What is the size of your PBIX file? The maximum size for datasets imported into the Power BI service is 1 GB and Power BI Service places a limit on the amount of uncompressed data that is processed during refresh to 10 GB.

If you still hit the above two limitations, you are not able to refresh dataset in Power BI Service. You can use DirectQuery/Live connection mode to connect to your data source instead, or purchase Power BI Premium license to solve this issue.

Regards,
Lydia

[albertoserinf]

Hello @v-yuezhe-msft

the PBIX file is just 80MB...

The problem is that (as I mentioned in the previous post) one of the table of the sql database we connected as source is bigger than 10GB.

So my question is: is there a chance to filter data only of a specific table of the entire database you import in Power BI Desktop?

If we are able to avoid loading in Power BI Desktop all the data coming from the "pick fact revenues" table then probably the limitation of the table bigger than 10GB is no more valid. I guess so...

Thanks

[v-yuezhe-msft]

@albertoserinf,

You can write T-SQL to select required columns and rows from this specific table, then load data to Power BI Desktop.


Regards,
Lydia

[albertoserinf · Accepted solution]

@v-yuezhe-msft

We solved this issue by creating a view of the table within the source database

Thanks for your hints.

Regards

Alberto