Utilizing Shortcuts from our Medallion Architecture - User Access Issue

[Maderthaner]

Hello there,

we followed the Microsoft Guidance and created one Workspace for each Bronze, Silver, Gold layer of our medallion architecture. We now have various source systems in our Bronze, Silver, Gold layers stored as delta parquets in our lakehouses.

We then have a lot of user workspaces that require data from our medallion architecture. 

- What works is creating physical 1:1 or partial copies of our Bronze, Silver, Gold data for the specific user workspaces and use notebooks to load the data to the user workspace (e.g., from the silver layer). It works, but it requires scripts to run, storage space, etc.. It's not ideal, but it works well for partial copies of data out of our medallion architecture.

- What doesn't work are Shortcuts, when following this pattern. I would need to authorize a user to our medallion workspaces (bronze, silver, gold) in which case that user would have access to all data - unfeasible! If I only authorize that user on the specific lakehouse the Shortcut is from, it shows some 1000 lines preview data, but not all and it shows an error that it couldn't load the table due to access issues.

Here the issue and Error Details:

Server Error.
Message : User is not authorized to access the files in storage path 'xxx/Tables/abrufleistungen/_delta_log/_last_checkpoint' for the table.
Error Code : UnauthorizedToAccessTableFiles
Error source : 1
Activity Id (Failed Request) : xxx
Client Session Id : xxx
User session Id : xxx

I understand that there is more to come to harmonize and make data access more granular and consistent. But can you please prioritize or support this Shortcut issue? We have mutliple workspaces (small specific user groups) that require access to entire ERP systems (but not all data in our medallion architecture). Happily coping entire ERP Systems for the analytics of a few users isn't really sustainable.

I feel like the feature shall be used exactly for that and I feel like we "use it the right way" as described above with permissions directly on the lakehouse. But it feels like it is a bit buggy / not working the way it is intended. Any thoughts on this?

[Anonymous]

Hi @Maderthaner ,

Apologies for the inconvenience.

Please reach out to our support team to gain deeper insights and explore potential solutions. It's highly recommended that you reach out to our support team. Their expertise will be invaluable in suggesting the most appropriate approach.

Please go ahead and raise a support ticket to reach our support team:

https://support.fabric.microsoft.com/support

After creating a Support ticket please provide the ticket number as it would help us to track for more information.

[Anonymous]

Hi @Maderthaner ,

We haven’t heard from you on the last response and was just checking back to see if you got a chance to open a support ticket.
After creating a Support ticket please provide the ticket number as it would help us to track for more information.

Thanks