Forum Discussion

taoyang's avatar
taoyang
New Member
9 years ago

Checking retention policy for existing datasets

After a dataset is created, is there a way to check the retention policy? I have created some datasets using REST API described in this blog article: https://powerbi.microsoft.com/en-us/blog/automati...
SudhamaiMannam's avatar
SudhamaiMannam
Microsoft Employee
4 years ago

All of the Data is stored in a storage i.e. Azure Data Lake by Power BI Service which is not directly accesible.

 

If you create a streaming dataset it is only accessibile via api. You can not directly delete a row from the dataset, the only way will be delete all rows via the api. A solution for your purpose can be, delete the rows in Power BI Desktop in the Editor after you connect to your dataset. The default rention is 200k and is handeld Fifo see the Picture Below from Microsoft.

 

 

for more Information

https://docs.microsoft.com/en-us/power-bi/developer/api-automatic-retention-policy-for-real-time-dat...

 

If you Post the 200001 Row to your Dataset the first posted row will be dropped.

You can Modifiy the Retention policy with

POST https://api.powerbi.com/v1.0/myorg/datasets?defaultRetentionPolicy={None | basicFIFO}

 

If you set your streaming Dataset to none retention you can store up to 5 Million rows but you some have Limits. ( See below).

 

To POST Rows

  • 75 max columns
  • 75 max tables
  • 10,000 max rows per single POST rows request
  • 1,000,000 rows added per hour per dataset
  • 5 max pending POST rows requests per dataset
  • 120 POST rows requests per minute per dataset
  • If table has 250,000 or more rows, 120 POST rows requests per hour per dataset
  • 200,000 max rows stored per table in FIFO dataset
  • 5,000,000 max rows stored per table in ‘none retention policy’ dataset
  • 4,000 characters per value for string column in POST rows operation

https://docs.microsoft.com/en-us/power-bi/developer/api-rest-api-limitations