Forum Discussion
Download Lakehouse Files
Update of my problem:
All the technologies I've seen above (unless I'm mistaken) only serve to update and send new data to a Lakehouse, and that's not what we're looking for here.To answer my question, which is :
I need to make the files I've created available to colleaguesWell, to do this, I changed direction: OneLake
I had to assign specific and restricted roles, install OneLake on all the machines so that each PC then had access to the desired folder
By pushing the files into a new Lakehouse, a new workspace and managing the roles, I was able to export the data.However, I'm only keeping all this for development, I wouldn't recommend it for production.
I have other ideas for putting the export of Lakehouse files into production, such as with Power Pages, but as I can't find any way of extracting the files at the moment, the idea has been put off.
If anyone comes up with an alternative method, don't hesitate !
VIvMouret
Try this approach instead of Graphql :
Use the Microsoft Fabric REST API. This allows you to programmatically access and download files by authenticating your app via Microsoft Entra (Azure AD). The process involves:
- App Registration: Register your application in Microsoft Entra ID, assign permissions (e.g., Lakehouse.Read.All), and obtain credentials (Client ID, Client Secret, Tenant ID).
- Authentication: Use these credentials to obtain an access token for API requests.
- File Access: Use the Fabric REST API to list files in the Lakehouse and construct URLs for downloading them.
https://learn.microsoft.com/en-us/fabric/data-engineering/lakehouse-api
Something like this :
import requests
file_url = "https://onelake.dfs.fabric.microsoft.com/<workspace>/<lakehouse>.lakehouse/path/to/file"
headers = {"Authorization": f"Bearer {token}"}
response = requests.get(file_url, headers=headers)
if response.status_code == 200:
with open("downloaded_file", "wb") as file:
file.write(response.content)
print("File downloaded successfully!")
else:
print(f"Failed to download file: {response.status_code}")
See if this is working
Thanks
I've already followed your first paragraph as a POC
To give you an idea of my code, I made this documentation at the beginning:
https://learn.microsoft.com/en-us/fabric/data-engineering/connect-apps-api-graphql
Then I moved on to this one as I was asked along the way:
https://learn.microsoft.com/en-us/entra/identity-platform/tutorial-single-page-app-react-prepare-spa?tabs=visual-studio-code
The documentation link you sent me doesn't include a query for downloading a file from a Lakehouse,
And even less in Python, I'm in NodeJS...