Copying a Json to another folder as Json. the specified path does not exist

DebbieE — Fri, 11 Oct 2024 11:53:33 GMT

I have a JSON file in a container project. then newdata. then projecta. then a dated folder 20240102 and then the file 2024010210100000.json

and I want to move it to the folder completed. I want it to create the projecta and the dated folder if they arent already created.

I tried preserve hierarchy but Im still getting

FileSystem: 'project'. Path: 'completed/projecta/20231007/2024010210100000.json'. ErrorCode: 'PathNotFound'. Message: 'The specified path does not exist.'

I have the copy set up like this:

Source

json data set with paramters rootFolder, filePath and fileName

And I coded in

rootFolder project

filePath newdata/apc/20231007/ (I use a parameter to set this so I can dynamically add the correct dated folder)

fileName 2024010210100000.json (again added dynamically so it can get the correct file)

Sink

json data set with paramters rootFolder, filePath and fileName

And I coded in

rootFolder project

filePath completed/apc/20231007/ (I use a parameter to set this so I can add the correct dated folder)

fileName 2024010210100000.json (again added dynamically so it can get the correct file)

And this isnt working because I only have completed

I thought it would just create the folder structure as it goes along. So a new day and when we copy across it would just create the folders.

can any one help me figure this out? I thought this would be a fairly simple one to do

Re: Copying a Json to another folder as Json. the specified path does not exist

Anonymous — Mon, 14 Oct 2024 03:08:39 GMT

Hi @DebbieE

I made a simple test like below. I created "completed" folder in advance. Then when I ran the pipeline for the first time, it created the sub directory "apc/20231007" and saved the file in this destination folder successfully. So it supports creating a directory when the directory doesn't exist.

For the 'PathNotFound' error, you may open the input of the failed activity, check whether the source and sink folder path and file names have correct values which are passed from the parameters.

Additionally, for the current copy data activity, does it intend to copy a single file or a list of files?

Best Regards,
Jing
If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!

topic Re: Copying a Json to another folder as Json. the specified path does not exist in Data Engineering

Copying a Json to another folder as Json. the specified path does not exist

Re: Copying a Json to another folder as Json. the specified path does not exist