topic Re: Bug: COPY Activity Additional Columns not populating in Pipelines

Bug: COPY Activity Additional Columns not populating

Anonymous — Fri, 10 Nov 2023 07:20:51 GMT

I have a pipeline COPY Activity where the source is a Blob Storage file (Data Lake Gen 2) and destination is either a Lakehouse Delta table or Warehouse table. None of the additional columns are being populated.

Tried with $$FILEPATH and various system variables, pipeline parameters

$$FILEPATH does not save properly. When I open the pipeline I see this. The Value has changed to Custom and there is an error message

Re: Bug: COPY Activity Additional Columns not populating

Anonymous — Fri, 10 Nov 2023 08:15:43 GMT

Hi Anonymous ,

Thanks for using Fabric Community,

I cannot find any bug, everything is working properly. I can also find $$FILEPATH at Value itself.

Please find below screenshot:

Destination Lakehouse:

Can you please confirm your source? Is it DataLake Gen 2 Storage Account?

Hope it is helpful. Please let me know incase of any further queries.

Re: Bug: COPY Activity Additional Columns not populating

Anonymous — Mon, 13 Nov 2023 19:23:48 GMT

Hi Anonymous ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond back with the more details and we will try to help.

Thank You

Re: Bug: COPY Activity Additional Columns not populating

Anonymous — Sat, 18 Nov 2023 12:34:08 GMT

Hi,

No I still have the problem. My UI does not show the UI but it is Azure Data Lake Storage Gen 2. My pipeline is more parameterised than your example

Re: Bug: COPY Activity Additional Columns not populating

Anonymous — Tue, 21 Nov 2023 16:29:43 GMT

Hi Anonymous ,

At this time, we are reaching out to the internal team to get some help on this .
We will update you once we hear back from them.

In meantime can you please share in which region* you are working?

Thank you

Re: Bug: COPY Activity Additional Columns not populating

Anonymous — Tue, 21 Nov 2023 13:00:40 GMT

Hi, what do you need to know?

Re: Bug: COPY Activity Additional Columns not populating

Anonymous — Tue, 21 Nov 2023 16:30:30 GMT

Hi Anonymous ,

I am asking in which region you are working?

Re: Bug: COPY Activity Additional Columns not populating

Anonymous — Tue, 21 Nov 2023 18:18:14 GMT

Re: Bug: COPY Activity Additional Columns not populating

Anonymous — Wed, 22 Nov 2023 08:54:21 GMT

Hi Anonymous ,

According to the screenshot you provided above, it seems to it's using dynamic content in the Additional columns, which is not able to see the columns option.

In this case, can you please help to check if the user is able to find the $$FILEPATH by these steps:

To add a New column
Or, by removing the dynamic content, the dropdown option will be available

Incase if it doesn't help please try to share below information.

I would like to know whether dynamic content was automatically generated or added it
manually?

If it's using the dynamic content, it'll be not able to see the dropdown option.

I would also like to know what connector you are using in this case?

Re: Bug: COPY Activity Additional Columns not populating

Anonymous — Mon, 27 Nov 2023 06:01:55 GMT

Hi Anonymous ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet.
In case if you have any resolution please do share that same with the community as it can be helpful to others.
Otherwise, will respond back with the more details and we will try to help.