topic Re: The request was blocked by DoSP PowerBI REST API in Developer

The request was blocked by DoSP PowerBI REST API

manumanu — Wed, 11 Aug 2021 12:12:20 GMT

Hi,

I have a DataFactory pipeline that sends a few HTTP requests to the PowerBI REST API, but sometime ago it started giving me the following error:

The request was blocked by DoSP

I can understand that it's a Denial of Service Protection. However, sometimes it fails on the first request.

We do have some of the requests inside a loop, to check when the PowerBI refresh is completed, but there's a 5min wait between them, so I don't understand why the DoSP is firing.

The Pipeline in question:

The loop part:

Cheers,

Manuel

Re: The request was blocked by DoSP PowerBI REST API

joost_romijn — Thu, 12 Aug 2021 04:05:35 GMT

I have the same issue.

Re: The request was blocked by DoSP PowerBI REST API

jvanegmond — Thu, 12 Aug 2021 10:12:26 GMT

Same issue here, I have a daily job that get Power BI metadata from admin/groups, admin/dataflows etc. Since 10th of August they started failing with this message:

{"error":{"message":"The request was blocked by DoSP <ClientEndpoint=XX.XX.XX.XXX:XXXXX>"}}

Re: The request was blocked by DoSP PowerBI REST API

jvanegmond — Thu, 12 Aug 2021 10:52:01 GMT

Found a thread about this issue: https://www.moderndata.ai/2019/05/powerbi-dataset-refresh-using-adf/

Marius got a reply from Microsoft

"Marius

2021-08-12 at 8:13

Hi agian everyone.

So, I have been in touch with Microsoft, and this is actually a known issue.

This is what I got as an answer:
It is a known issue from Power BI end.

Product Team is still working on this issue. But I want to collect few traces from your end and share with them.

The cause of this issue is certain IP of ADF Azure integration runtime (IR) in your region is blocked due to PowerBI’s Dos Protection mechanism.

They have provided a workaround for this issue:
We could use Azure IR (Integration runtime) in other regions(outside of existing one) or use a selfhosted IR in web activity to the temporarily workaround this issue.

So, we had a selfhosted IR in our ADF, and when I switched to this it workes like a charm again. This you need to change in the “Call Dataset Refresh” component in the ADF pipeline.

Best regards
Marius"

Re: The request was blocked by DoSP PowerBI REST API

joost_romijn — Thu, 12 Aug 2021 10:56:10 GMT

Nice, thanks

Re: The request was blocked by DoSP PowerBI REST API

manumanu — Thu, 12 Aug 2021 13:34:19 GMT

Thanks, this makes total sense.

Thankfully we already have an SelfHosted IR, so I'll use that one instead.

Thanks for the help!

Re: The request was blocked by DoSP PowerBI REST API

khush19 — Fri, 08 Apr 2022 16:23:11 GMT

How is this Issue resolved?

Re: The request was blocked by DoSP PowerBI REST API

manumanu — Fri, 08 Apr 2022 16:38:32 GMT

Hey!

We resolved this issue by sending the http request using a SelfHosted Integration Runtime. This fixes the issue since the IP of the machine is sending only a few requests to the PowerBI Service and it's an IP address only for us.

When you or anyone else uses the Azure Integration Runtime (the default setting) there's probably several thousand requests being sent to PowerBI using the same IP address. So when a threshold is reached, PowerBI service starts blocking those IPs.

Re: The request was blocked by DoSP PowerBI REST API

khush19 — Sun, 10 Apr 2022 05:14:11 GMT

Thanks for reply,but for SelfHosted IR we need additional virtual machine .

I tried creating new Azure IR with Different region but still getting error, due to which our lot of customer are getting impacted 😞