Dataflows Status code: 400 description: 'The block list may not contain more than 50 000 blocks.

[rkshanmugaraja]

Hi All

On Power BI Premium capacity, I created a dataflow to push a large fact table with 1 billion rows. the refresh failed with the error message  "'. Status code: 400 description: 'The block list may not contain more than 50 000 blocks.'."

The workspace Default storage format is set to " Large dataset storage format". 

Please help. 

Error Message : 

Error: Data Source Error : DataSource.Error: AzureBlobs failed to get contents from 'https://xxxxx.blob.core.windows.net/43ebd9084f5c/Query/part-2022.csv'. Status code: 400 description: 'The block list may not contain more than 50 000 blocks.'. DataSourceKind = <ccon>AzureBlobs</ccon> DataSourcePath = <ccon>https://xxxx.blob.core.windows.net/43ebd9084f5c/Query/part-2022.csv</ccon> Url = <ccon>https://xxxx.blob.core.windows.net/43ebd9084f5c/Query/part-2022.csv</ccon>. RootActivityId = 0c68447b-4cc2-4d73-a9db.Param1 = DataSource.Error: AzureBlobs failed to get contents from 'https://xxxx.blob.core.windows.net/43ebd9084f5c/Query/part-2022.csv'. Status code: 400 description: 'The block list may not contain more than 50 000 blocks.'. DataSourceKind = <ccon>AzureBlobs</ccon> DataSourcePath = <ccon>https://xxxx.blob.core.windows.net/43ebd9084f5c/Query/part-2022.csv</ccon> Url = <ccon>https://xxxx.blob.core.windows.net/43ebd9084f5c/Query/part-2022.csv</ccon>

[lbendlin]

Partition sizes are Day, Month, Quarter,Year.  Try with monthly sizes and if that doesn't work go to daily.

Instead of "Keep last five years" you need to say "Keep last 60 months" etc.

[rkshanmugaraja]

Thanks Ibendlin, 

How do I determine the partition granularity not to exceed the 50000 blocks on Blob storage ? 

Is there any correlation between partition and this block size (50k) or is there any best practice to avoid this ? 

I need to last one year data with last 1 month incremental refresh. 

Many thanks in advance. 

[lbendlin]

Use incremental refresh with an appropriate partition granularity.