Power BI is turning 10! Tune in for a special live episode on July 24 with behind-the-scenes stories, product evolution highlights, and a sneak peek at what’s in store for the future.
Save the dateEnhance your career with this limited time 50% discount on Fabric and Power BI exams. Ends August 31st. Request your voucher.
Hello,
On Saturday, we began receiving intermittent (but frequent**) errors in our Fabric notebooks that use mssparkutils.runMultiple for parallelizing Spark jobs. The error looks like a 429/500 error trying to hit an internal Microsoft token endpoint to authenticate. The maximum concurrency we are using is 5, so I'm surprised that this would cause a 429 error.
Caused by: java.lang.Exception: Request to https://tokenservice1.northcentralus.trident.azuresynapse.net/api/v1/proxy/preprocessorApi/versions/... failed with status code: 500, response:{"error":"WorkloadApiInternalErrorException","reason":"Internal error 429.Internal error PBIServiceException. (ErrorCode=429) (HTTP 500)"}
We have retries setup in the pipeline so now that the error rate has reduced from 100% to only aboug 25-33%, we are able to complete our pipeline runs, but it is still concerning that a low volume of queries could produce a 429 error. We have an F64 SKU and our compute usage during these jobs stays below 25%.
Has anyone else received this same issue, and if so, were you able to find a root cause?
**From Saturday through Sunday, this was happening for close to 100% of notebooks running mssparkutils.runMultiple, but since then it has become less frequent, about 1/3 or 1/4 notebooks have this failure.
Hi @dseym-brb ,
Based on the information you provided, a 429 error usually indicates that the service is receiving too many requests in a short period of time. Here are some potential causes and solutions that can lead to similar issues:
Best Regards,
Ada Wang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
This is your chance to engage directly with the engineering team behind Fabric and Power BI. Share your experiences and shape the future.
User | Count |
---|---|
5 | |
4 | |
2 | |
2 | |
2 |