Quota for Amount of Data Being Processed on PowerBI

[shuuri]

Hi,

Does PowerBI has quota on the amount of data being processed? 

I have 2 devices sending data to PowerBI using data streaming with API (push method) every 30 seconds. The data is very small, approximate 1KB. It suppose still within the limit if based on the streaming dataset matrix as below. However, after some time (randomly), the device will failed to reach the PowerBI endpoint with error message "requests.exceptions.HTTPError: 500 Server Error: Internal Server Errors for url: https://api.powerbi.com/beta/<id>/datasets/<id>/rows?experience=power-bi\u0026key=<key>". Please help!

Thanks.

[_elbpower · Accepted solution]

The limitation "5 max pending POST rows requests per dataset" in Power BI refers to a restriction on the number of pending requests to add rows to a dataset in Power BI when using the POST rows API. Let me break down what this limitation means:

1. POST Rows API: Power BI allows you to programmatically add or push rows of data into a dataset using the POST Rows API. This is a common way to automate data updates in Power BI.

2. Max Pending Requests: This limitation is about the maximum number of pending (unprocessed) requests that can be in the queue for adding rows to a dataset. In this context, "pending" means requests that have been made but have not yet been processed by the Power BI service.

3. 5 Max: The specific number "5" indicates that you can have a maximum of 5 pending POST rows requests at any given time for a single dataset. This means that if you send more than 5 requests to add rows to the same dataset without waiting for some of them to be processed, additional requests will be rejected until the number of pending requests drops below 5.

This limitation is in place to manage server resources and prevent abuse of the API, ensuring fair usage and performance stability in the Power BI service. If you need to send more than 5 requests concurrently, you may need to implement a queuing mechanism in your application to manage and control the rate at which you submit requests to the Power BI API.

[shuuri]

Hi XiaoXin(@Anonymous),

Thanks for your reply. Have couple of doubts here.

1. What is the pending POST mentioned on the "5 max pending POST rows requests per dataset"?
2. Does this limitation applies to all licenses include the trial version?
3. As per my use case, do you have any idea what caused the the devices failed to reach the PowerBI endpoint with error message "requests.exceptions.HTTPError: 500 Server Error: Internal Server Errors for url: https://api.powerbi.com/beta/<id>/datasets/<id>/rows?experience=power-bi\u0026key=<key>"? There are 2 devices (each pushing data for every 30secs). Both are pushing smoothly, however, after some time they failed to worked. The code pushing the data is written in Python.
Thanks.

[Anonymous]

HI @shuuri,

I'd like to suggest you take a look the following document about rest API limitations of these scenarios meet to the scenario.

Power BI REST APIs push datasets limitations - Power BI | Microsoft Learn

Regards,

Xiaoxin Sheng