Forum Discussion

sureshabey1's avatar
sureshabey1
New Member
6 months ago
Solved

Read ADLS gen 2 file through Notebook using a Connection

Hi,  I am trying to run a simple read spark stream query with in fabric notebook.  I have used workspace identity mechanism for connection creation to storage account. https://learn.microsoft.com/...
Notebook
  • deborshi_nag's avatar
    deborshi_nag
    6 months ago

    Hello sureshabey1 

     

    Since you're using the fully qualified abfs location, I'm guessing you have not created the OneLake shortcut. Follow the Microsoft doc link you shared to create a OneLake shortcut pointing to the folder in your external storage. Use Workspace Identity when creating the shortcut. Once done, attach the notebook to the Lakehouse and use /Files/<shortcut name> instead of the abfs location. 

    Secondly, if your storage is behing a firewall, please check you've used Trusted Workspace Access.

     

Shreya_Barhate's avatar
Shreya_Barhate
Resolver II
6 months ago

hi sureshabey1 ,

Workspace identity works only for scenarios where Fabric uses -workspace identity to authenticate—specifically when connecting OneLake shortcuts, Data Pipelines, Semantic Models, and Dataflows Gen2 (CI/CD) to external data sources.
It does not currently authenticate Spark notebooks for direct file access to ADLS Gen2. For notebooks, you must use either user identity, service principal, or managed identity configured through a linked service with appropriate ACL/RBAC permissions.


Thanks and regards,
Shreya Barhate