Forum Discussion
Solved
Copy Lakehouse Files
Hi All,
I'm trying to use a notebook to copy the Files directory from one lakehouse to another. It looks something like this:
sourcePath = f"{[sourceAbfsPath]}/Files"
targetPath = f"{[targetAbfsPath]}/Files"
notebookutils.fs.cp(sourcePath, targetPath, True)
That creates the addition Files subdirectory so Files>Files>test.xlsx
If I remove Files from the target or source path it gives a Bad Request 400 Error.
Without having to list the contents and copy them individually, is there a way to copy the entire files directory correctly?
Thanks!
I also can't move directories or files into the Files folder using
notebookutils.fs.mv() . Possibly due to the Files folder being a managed OneLake folder so CRUD operations are restricted to it. This post, mssparkutils file operations, ran into the same issue and has a more detailed explination in the replies. Going to follow their solution of creating a subdirectory within Files to house everything; it seems like the simplest and most flexible solution.
2 Replies
PANDAmonium There is a similar solved solution here: Solved: Copy tables and files (quickly) between two lakeho... - Microsoft Fabric Community. I believe that this should help you get you where you need to be.
I also can't move directories or files into the Files folder using
notebookutils.fs.mv() . Possibly due to the Files folder being a managed OneLake folder so CRUD operations are restricted to it. This post, mssparkutils file operations, ran into the same issue and has a more detailed explination in the replies. Going to follow their solution of creating a subdirectory within Files to house everything; it seems like the simplest and most flexible solution.
