topic Re: Read ADLS gen 2 file through Notebook using a Connection in Data Engineering

Read ADLS gen 2 file through Notebook using a Connection

sureshabey1 — Fri, 06 Feb 2026 03:33:21 GMT

Hi,

I am trying to run a simple read spark stream query with in fabric notebook.

I have used workspace identity mechanism for connection creation to storage account.

https://learn.microsoft.com/en-us/fabric/security/workspace-identity-authenticate

from pyspark.sql import SparkSession

from pyspark.sql.functions import col, lit, struct, to_json

from delta.tables import *

spark = SparkSession.builder.getOrCreate()

df = (

spark.readStream

.format("json")

.schema("site_Group string, site string)

.option("recursiveFileLookup", "true")

.option("ignoreMissingFiles", "true")

.option("withEventTimeOrder", "true")

.load("abfss://landing-zone@xyz_storageaccount.dfs.core.windows.net/Y/")

)

I have given the workspace the azure blob data reader access at the storage account level.

But still getting access related issue to read the file.

Operation failed: "This request is not authorized to perform this operation.", 403, HEAD

Any help would be appreciated.

Re: Read ADLS gen 2 file through Notebook using a Connection

deborshi_nag — Fri, 06 Feb 2026 07:39:34 GMT

Hello @sureshabey1

Since you're using the fully qualified abfs location, I'm guessing you have not created the OneLake shortcut. Follow the Microsoft doc link you shared to create a OneLake shortcut pointing to the folder in your external storage. Use Workspace Identity when creating the shortcut. Once done, attach the notebook to the Lakehouse and use /Files/<shortcut name> instead of the abfs location.

Secondly, if your storage is behing a firewall, please check you've used Trusted Workspace Access.

Re: Read ADLS gen 2 file through Notebook using a Connection

Shreya_Barhate — Fri, 06 Feb 2026 10:13:06 GMT

hi @sureshabey1 ,

Workspace identity works only for scenarios where Fabric uses -workspace identity to authenticate—specifically when connecting OneLake shortcuts, Data Pipelines, Semantic Models, and Dataflows Gen2 (CI/CD) to external data sources.
It does not currently authenticate Spark notebooks for direct file access to ADLS Gen2. For notebooks, you must use either user identity, service principal, or managed identity configured through a linked service with appropriate ACL/RBAC permissions.

Thanks and regards,
Shreya Barhate

Re: Read ADLS gen 2 file through Notebook using a Connection

v-echaithra — Fri, 13 Feb 2026 10:03:00 GMT

Hi @sureshabey1 ,

Thank you @Shreya_Barhate , @deborshi_nag for your inputs.

We’d like to follow up regarding the recent concern. Kindly confirm whether the issue has been resolved, or if further assistance is still required. We are available to support you and are committed to helping you reach a resolution.

Thank you for your patience and look forward to hearing from you.
Best Regards,
Chaithra E.

Re: Read ADLS gen 2 file through Notebook using a Connection

v-echaithra — Mon, 16 Feb 2026 09:44:05 GMT

Hi @sureshabey1 ,

May I ask if you have resolved this issue? Please let us know if you have any further issues, we are happy to help.

Thank you.