Replicating Move behavior in Fabric pipelines

Hi arpost 

When we were implementing this sort of behaviour, I typically used mv operation in the Spark notebook.

The link on the library:

https://learn.microsoft.com/en-us/fabric/data-engineering/microsoft-spark-utilities

While I can't guarantee how it works under the hood, but the "mv" command, it seems, does exactly what you want.

Also we observed using notebooks is very convenient way for that sort of operations. While you are mentioning the Data Pipeline, this approach is slightly different. But anyway, we didn't have any problems with that. Also, due to coding essence of the notebook, we noticed, it is much easier to configure exception handling during this sort of operations.

Conclusion. If notebook way is good for you, I strongly suggest to try it. 

Thanks for good question and proactive position. I hope it helps. Kudo (like) and making answer as a solution will help me and others to contribute and use that contribution more effectively.

BR, Yurri