Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
7 years ago
Solved

Push Dataset Record Level Limitation (Live Connection)

I am getting below error in our Live Power BI connection setup (using Push dataset).  I have a large dataset about 600k rows.

 

Spoiler
Error : System.Net.WebException: The remote server returned an error: (429).

In this article - https://www.techtalkcorner.com/power-bi-api-dataset-limit/ - limitations are mentioned that 

  •  Send multiple rows in a single request (up to 10.000) but be aware of the limitation per hour (1.000.000)
  • Post Requests per minute which is 120 requests per dataset

 

Can any one help me understand these limiations?  Does it mean we can only push total 1million rows in an hour in one dataset?  Is there any similar record level limitation at workspace level?

 

Embed dataset via API

live connection limitation? 

  • Anonymous's avatar
    Anonymous
    7 years ago

    HI Anonymous ,

    I'd like to suggest you to take a look at following document first, it mention the limitations when you use post datasource.

    Power BI REST API limitations

     

    Spoiler

    To POST Rows

    • 75 max columns
    • 75 max tables
    • 10,000 max rows per single POST rows request
    • 1,000,000 rows added per hour per dataset
    • 5 max pending POST rows requests per dataset
    • 120 POST rows requests per minute per dataset
    • If table has 250,000 or more rows, 120 POST rows requests per hour per dataset
    • 200,000 max rows stored per table in FIFO dataset
    • 5,000,000 max rows stored per table in ‘none retention policy’ dataset
    • 4,000 characters per value for string column in POST rows operation

     

    >> Is there any similar record level limitation at workspace level?

    As document said, power bi has limitation on data amount and frequency when you use rest api to send data. Current it not has limitations on workplace level, but you need to check your capacity amount to confirm if data amount are over limit.

    Manage data storage in Power BI workspaces

    Regards,

    Xiaoxin Sheng

2 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    HI Anonymous ,

    I'd like to suggest you to take a look at following document first, it mention the limitations when you use post datasource.

    Power BI REST API limitations

     

    Spoiler

    To POST Rows

    • 75 max columns
    • 75 max tables
    • 10,000 max rows per single POST rows request
    • 1,000,000 rows added per hour per dataset
    • 5 max pending POST rows requests per dataset
    • 120 POST rows requests per minute per dataset
    • If table has 250,000 or more rows, 120 POST rows requests per hour per dataset
    • 200,000 max rows stored per table in FIFO dataset
    • 5,000,000 max rows stored per table in ‘none retention policy’ dataset
    • 4,000 characters per value for string column in POST rows operation

     

    >> Is there any similar record level limitation at workspace level?

    As document said, power bi has limitation on data amount and frequency when you use rest api to send data. Current it not has limitations on workplace level, but you need to check your capacity amount to confirm if data amount are over limit.

    Manage data storage in Power BI workspaces

    Regards,

    Xiaoxin Sheng

    • Anonymous's avatar
      Anonymous
      Not applicable

      Thank you so much Anonymous .

       

      I have a few follow up questions:

      • 75 max columns - Does it mean we cannot have more than 75 columns in one dataset (push)?
      • 75 max tables - What does it mean.. we cannot have more than one table in a single live dataset?
      • 10,000 max rows per single POST rows request - I am able to push 600k rows so is it working because we are sending multiple POST rows request?
      • 1,000,000 rows added per hour per dataset - in our setup, we our using live dataset in embedded reports.  There is one master PowerBI pro account that is used to Push the dataset.  I wan to ask.. if we have 10 requests accessing the same report - will it the records count be added from all the requests?  I am assuming the logical answer is yes. 
      • 120 POST rows requests per minute per dataset
      • If table has 250,000 or more rows, 120 POST rows requests per hour per dataset - this is confusing.. I am able to push 600k rows in 330 secs in one dataset.
      • 4,000 characters per value for string column in POST rows operation - It this the limit of max characters for string?

       

      Kindly help!  Thank you so much in advance!