Fabric REST API (Get Published Libraries)

[jeremycolson1]

We are attempting to leverage the Fabric REST APIs to retrieve information on published libraries within a given spark environment. However, the subset of APIs related to Spark Libraries does not seem to be working. All the other endpoints related to workspaces, environments, spark compute, etc. work without issue.

When we attempt to access the spark libraries endpoint:

GET https://api.fabric.microsoft.com/v1/workspaces/{workspaceId}/environments/{environmentId}/libraries

We receive an ambiguous 500 error:

{
  "requestId": "<redacted>",
  "errorCode": "UnknownError",
  "message": "An error occurred while processing the operation"
}

We do realize these endpoints only support User Identities at this point in time and the user running the code (within the notebook) has admin access across Fabric (full CRUD access to all environments). We have tried calling the API via sempy and using good old requests as well (just to weed out any potential problems there) and we receive the same result.

Has anyone been able to successfully use this subset of endpoints? We are starting to get the sense they are simply broken.

[jeremycolson1]

Issue has not been resolved yet, but has been escalated to the product team. Will post an update once they reach a resolution on this and provide a root cause.

[jeremycolson1]

Product team identified the problem... sounds like it might affect more clients than just us. Within the workspace settings, under the spark config, if you're using a default environment it can result in 500 errors being generated when accessing the Fabric Spark Environment publish APIs. If you turn off the default environment the API starts working again. When you re-enable the default environment, in some cases the problem ceases to exist, in other cases, you are back to receiving internal errors from the APIs (some issue w/ the underlying metadata). Fix is supposed to be merged this week, but who knows when it will get pushed out to production.

[Anonymous]

Hi,@jeremycolson1 

At the moment you mentioned that you encountered a 500 error when trying to access the Spark Libraries endpoint. This error usually indicates that the server is experiencing a problem processing the request. Based on the information I found, this issue may be related to the current state of the API, as these endpoints are currently in preview and there may be some bugs that have not yet been resolved.

Here is a screenshot of the official documentation:
 

Here are the official documents
Manage the environment through public APIs - Microsoft Fabric | Microsoft Learn
 

Second, try something else: you can try using a different tool or library to call the API, to troubleshoot issues with your code implementation.
 

Finally, you can check whether the user has sufficient permissions for the workspace and whether there are any mistakes in your filling.

Of course, if you have new ideas or discoveries, please feel free to communicate with us.

Best Regards,

Leroy Lu

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[jeremycolson1]

I understand it's in preview, but I would expect it to at least somewhat function when in public preview. If the API simply does not work, it should not even be in private preview, let alone public preview. There's a big difference between having issues/bugs and just not working at all.

We have tried calling the API using several methods (e.g., sempy, requests, postman, etc.). And we know this is not a permissions issue.

Also, add to that we have yet to hear of any organization where this has actually worked... everything would point to this API just being broken.

Were you able to successfully get this API endpoint to work?

[Anonymous]

Hi, @jeremycolson1 

Thanks for the quick reply.

So far, I've tested the API command in both ways, so we speculate that there might be a problem with your configuration, and here are my test results:

You can create a support ticket for free and a dedicated Microsoft engineer will come to solve the problem for you.

It would be great if you continue to share in this issue to help others with similar problems after you know the root cause or solution.

The link of Power BI Support: https://powerbi.microsoft.com/en-us/support/

For how to create a support ticket, please refer to How to create a support ticket in Power BI - Microsoft Fabric Community

Thank you for your understanding.

Of course, if there is anything we have overlooked, you are also welcome to communicate with us in time.

Looking forward to hearing from you.

Best Regards,

Leroy Lu

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.