Forum Discussion
1569hypernova
1 year agoFrequent Visitor
Intermittent issues with accessing files over ADLSv2 shortcut using "File API path" from a notebook
Ive been using a notebook to process files from a ADLSv2 shortcut. The data on ADLSv2 is created by Azure Synapse Link for Dataverse with Azure Data Lake. The issue is that i cant access files over "...
- 1 year ago
Hello 1569hypernova
path = mssparkutils.fs.getMountPath("/your_shortcut_path")
files = mssparkutils.fs.ls(path)
Please check if this working for you.
Not officially known issue but other user have reported similar type of issue
https://www.reddit.com/r/MicrosoftFabric/comments/1ff5vd9/anyone_else_having_intermittent_errors_with/Please accept the answer if this is helpful and give kudos
Thanks
1569hypernova
1 year agoFrequent Visitor
Thanks @nilendraFabric for the idea and links. Unfortionally mssparkutils experiences the same issue. Non of the links seems to be the same issue, at least on a surface level.
However, mssparkutils.fs.ls returns an empty list so for now I just made a loop to wait for my shortcut to be accessible if\when the issue occurs as a workarround.
df_mnt = mssparkutils.fs.ls(f"file://{mssparkutils.fs.getMountPath('/default/Files/synapse_link/')}")
while not df_mnt:
print("Waiting 10 seconds for shortcut to mount...")
sleep(10)
df_mnt = mssparkutils.fs.ls(f"file://{mssparkutils.fs.getMountPath('/default/Files/synapse_link/')}")