Power BI Server Capacity

[fatimapz]

Hello Power BI community,

I'm currently encountering an issue while attempting to update a report on the Power BI Server, and I'm seeking your expertise to help me troubleshoot and resolve the problem.

Error Details:

I have the "Premium per user" license. I am working with a 25 GB CSV file. First, in Power BI Desktop, I generate a report using a smaller sample (stored in SharePoint) extracted from the CSV, which is under 1 GB in size. After creating the report, I publish it to Power BI Server. Later, in SharePoint, I swap the sample CSV with the original 25 GB CSV file. Following this update, I refresh the dataset for the report uploaded to Power BI Server to reflect the changes made with the larger CSV file. 

I have checked my network connection, ensured that the data sources are accessible, and reviewed the refresh settings, but the issue persists.

[Anonymous]

hi, @fatimapz 

I'm happy to answer your questions. From your previous description and error message, I noticed that an error occurred when you refreshed the report: An error occurred while processing the dataset, mainly triggered by the IDataReader interface. So we can troubleshoot the problem from the following aspects:

1. Premium capacity limitations. For details, please refer to the table below and the link below.
   
   

   Premium capacity document: https://learn.microsoft.com/en-us/power-bi/enterprise/service-premium-what-is

2. Dependency problem. If your report depends on other reports or semantic models or queries, make sure they are properly related.
3. Data model issues. Try reloading the data model in Power BI Desktop to ensure that all data can be loaded correctly and re-publish it to Power BI Service. Check by having a disconnected table. Sample (stored in SharePoint) has the same columns as the 25G table in SharePoint, and the data format is the same. If some data in the 25G table is in incorrect format or is missing, it will cause read errors.
   

   Below are some posts that encountered the same problem, you can click to view more information:

   https://community.fabric.microsoft.com/t5/Service/Internal-Service-Error-Refresh-Failed/td-p/1387800

   https://community.fabric.microsoft.com/t5/Service/The-exception-was-raised-by-the-IDataReader-interf...

   If the above suggestions can help you, that would be great.

How to Get Your Question Answered Quickly

If it does not help, please provide more details with your desired output and pbix file without privacy information (or some sample data) .

Best Regards

Jianpeng Li

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[aj1973]

Hi @fatimapz 

What connector did you use to connect to Sharepoint?

Can you show the M Code please?

[fatimapz]

Hi @aj1973, 

This is the code for my advanced editor: 

let
Origen = SharePoint.Files("https://****csp.sharepoint.com/00004**4/0**05143/proyectos/***", [ApiVersion = 15]),
#"Maestro Via de Pago csv_https://***csp sharepoint com/00004**4/0**05143/proyectos/***/Documentos compartidos/Documentos/" = Origen{[Name="Maestro Via de Pago.csv",#"Folder Path"="https://***csp.sharepoint.com/00004**4/0**05143/proyectos/***/Documentos compartidos/Documentos/"]}[Content],
#"CSV importado" = Csv.Document(#"Maestro Via de Pago csv_https://****csp sharepoint com/00004**4/0**05143/proyectos/***/Documentos compartidos/Documentos/",[Delimiter="|", Columns=2, Encoding=65001, QuoteStyle=QuoteStyle.None]),
#"Tipo cambiado" = Table.TransformColumnTypes(#"CSV importado",{{"Column1", type text}, {"Column2", type text}}),
#"Encabezados promovidos" = Table.PromoteHeaders(#"Tipo cambiado", [PromoteAllScalars=true]),
#"Tipo cambiado1" = Table.TransformColumnTypes(#"Encabezados promovidos",{{"Via de pago", type text}, {"Texto pago", type text}})
in
#"Tipo cambiado1"

Thanks in advance.

[aj1973]

All looks good except maybe here

try to change it to "," please

[fatimapz]

I am using a pipe ('|') as a delimiter in the CSV. I've tested the same process on a CSV with significantly fewer data, and it works well. However, the issue arises when dealing with the 25 GB file.

[aj1973]

What is the size of the pbix file?

[fatimapz]

The Power BI file that I am uploading to the server (containing the sample from the original csv) has a size of 128,153 KB.

[aj1973]

You said the sample is refreshing fine didn't you?

I was asking about 25GB csv file when imported entirely.

Anyway as you have described the issue arise when dealing with 25GB, I think your model has hit the capacity limit of the workspace. Please check this out

Power BI Premium Per User - Power BI | Microsoft Learn