Forum Discussion

prathijp's avatar
prathijp
Helper I
10 months ago
Solved

How to read/write lakehouse files from Linux/python solution?

What are the best option for reading/writing files from/to lalehouse folders from othe VMs/linux boxes/python solutions? What is the lease permission I can grant for app developers?
one lake
security
  • SaiTejaTalasila's avatar
    SaiTejaTalasila
    9 months ago

    Hi prathijp ,

     

    To read or write files from Lakehouse folders using Linux or Python, the best options are:

     

    1. OneLake REST API - You can use Python (requests or httpx) to interact with OneLake endpoints for uploading, downloading, or listing files.

     

    2. ABFS Paths - Lakehouse files are accessible via Azure Blob File System (ABFS). You can use Azure CLI or Python SDK (azure-storage-file-datalake) to connect and manage files from Linux environments.

     

    3. Mounting via ADLS

     

    Gen2-compatible tools - If your VM supports it, you can mount OneLake as a filesystem ateract with it like local storage(only on windows).

     

    Thanks,

    Sai Teja 

SaiTejaTalasila's avatar
SaiTejaTalasila
Super User
9 months ago

Hi prathijp ,

 

To read or write files from Lakehouse folders using Linux or Python, the best options are:

 

1. OneLake REST API - You can use Python (requests or httpx) to interact with OneLake endpoints for uploading, downloading, or listing files.

 

2. ABFS Paths - Lakehouse files are accessible via Azure Blob File System (ABFS). You can use Azure CLI or Python SDK (azure-storage-file-datalake) to connect and manage files from Linux environments.

 

3. Mounting via ADLS

 

Gen2-compatible tools - If your VM supports it, you can mount OneLake as a filesystem ateract with it like local storage(only on windows).

 

Thanks,

Sai Teja