Copy Lakehouse Files

[PANDAmonium]

Hi All,

I'm trying to use a notebook to copy the Files directory from one lakehouse to another. It looks something like this:

sourcePath = f"{[sourceAbfsPath]}/Files"

targetPath = f"{[targetAbfsPath]}/Files"

notebookutils.fs.cp(sourcePath, targetPath, True)

That creates the addition Files subdirectory so Files>Files>test.xlsx

If I remove Files from the target or source path it gives a Bad Request 400 Error.

Without having to list the contents and copy them individually, is there a way to copy the entire files directory correctly?

Thanks!

[PANDAmonium · Accepted solution]

I also can't move directories or files into the Files folder using 

notebookutils.fs.mv() . Possibly due to the Files folder being a managed OneLake folder so CRUD operations are restricted to it.  This post, mssparkutils file operations, ran into the same issue and has a more detailed explination in the replies. Going to follow their solution of creating a subdirectory within Files to house everything; it seems like the simplest and most flexible solution.

[GeraldGEmerick]

@PANDAmonium There is a similar solved solution here: Solved: Copy tables and files (quickly) between two lakeho... - Microsoft Fabric Community. I believe that this should help you get you where you need to be.