Forum Discussion

ramonsuarez's avatar
ramonsuarez
Advocate II
2 years ago
Solved

Programmatically upload files to Fabric?

Hi,    We want to be able to periodically upload a set of files to fabric, always to the same folder and overwritting the previous versions of those files.    We have a PowerShell script in a ser...
Data Engineering
  • govindarajan_d's avatar
    govindarajan_d
    2 years ago

    Hi ramonsuarez ,

    You can also try installing 'OneLake' program in the server and you can use it just like how you use 'OneDrive'. This approach will require just adding a copy statement in your existing powershell script 

     

v-cboorla-msft's avatar
v-cboorla-msft
Microsoft Employee
2 years ago

Hi ramonsuarez 

 

Could you please confirm whether you are using Notebook or Pipeline?

What is the source of your data, will it be accessible from Notebook?

 

Thanks

ramonsuarez's avatar
ramonsuarez
Advocate II
2 years ago

Neither. The script runs on a server and extracts the tables from the source system as xml files. 

  • v-cboorla-msft's avatar
    v-cboorla-msft
    Microsoft Employee
    2 years ago

    Hi ramonsuarez 

     

    There are multiple ways to upload files to OneLake. You can try these options:

    1. Pipelines (as Sumit Kumar pointed out earlier)
    2. AZCOPY (they call the CLI and it copies files to /Tables directory). There's a good blog covering the details available here. Ingest Data into Microsoft Fabric OneLake using AzCopy | by Inderjit Rana | Microsoft Azure | Medium
    3. APIs

    I hope this information helps. Please do let us know if you have any further questions.

     

    Thanks

    • v-cboorla-msft's avatar
      v-cboorla-msft
      Microsoft Employee
      2 years ago

      Hi ramonsuarez 

       

      We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet.
      In case if you have any resolution please do share that same with the community as it can be helpful to others.
      Otherwise, will respond back with the more details and we will try to help.


      Thanks

      • ramonsuarez's avatar
        ramonsuarez
        Advocate II
        2 years ago

        A colleague found a Power Shell script to upload directly from the server and run it with Windows Task Scheduler.