High concurrency no longer working

[Soobramoney]

Hi,

I am currently using high concurrency in my notebooks, which are part of a data pipeline. However, since last Sunday, it has stopped working. The pipeline fails with the following error:

[TABLE_OR_VIEW_NOT_FOUND]

This error occurs when querying a Lakehouse table in notebooks that are part of the pipeline. When I disable high concurrency in the workspace settings, the pipeline works as expected.

Unfortunately, I need high concurrency enabled, and I am unsure if this issue is related to a new bug.

Could you please assist?

Best regards

[Soobramoney · Accepted solution]

Hi, MS was working on a feature that impacted high concurrency. They have since reverted those changes, and high concurrency is now working again

[Anonymous]

Hi @Soobramoney ,

Does your problem persist? As of now, there are no issues related to having high concurrency mode turned on.

Also for the TABLE_OR_VIEW_NOT_FOUND error reporting, you can refer to the following documentation:

TABLE_OR_VIEW_NOT_FOUND error class - Azure Databricks | Microsoft Learn

Best Regards,
Adamk Kong

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[CodPilot]

Same here. All working fine until a few days ago and now failing with the same error.
I've raised a support ticket with MS so if I get anywhere with that, will post on here.

[NightOwl_234]

We are experiencing the same and we have had to turn off the the High Concurrency tab

Anyone got a workaround as we have tried all options