Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
SteveDevine
Helper I
Helper I

Bug: COPY Activity Additional Columns not populating

I have a pipeline COPY Activity where the source is a Blob Storage file (Data Lake Gen 2) and destination is either a Lakehouse Delta table or Warehouse table. None of the additional columns are being populated.

Tried with $$FILEPATH and various system variables, pipeline parameters

 

$$FILEPATH does not save properly. When I open the pipeline I see this. The Value has changed to Custom and there is an error message

SteveDevine_0-1699600802522.png

 

9 REPLIES 9
SteveDevine
Helper I
Helper I

Hi, what do you need to know?

Anonymous
Not applicable

Hi @SteveDevine ,

I am asking in which region you are working?

uk

Anonymous
Not applicable

Hi @SteveDevine ,

According to the screenshot you provided above, it seems to it's using dynamic content in the Additional columns, which is not able to see the columns option.

In this case, can you please help to check if the user is able to find the $$FILEPATH by these steps:
 

  • To add a New column
    MicrosoftTeams-image (7).png

  • Or, by removing the dynamic content, the dropdown option will be available

    MicrosoftTeams-image (8).png

 

Incase if it doesn't help please try to share below information.

I would like to know whether dynamic content was automatically generated or added it
manually?

MicrosoftTeams-image (9).png

 If it's using the dynamic content, it'll be not able to see the dropdown option.

I would also like to know what connector you are using in this case?




Anonymous
Not applicable

Hi @SteveDevine ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet.
In case if you have any resolution please do share that same with the community as it can be helpful to others.
Otherwise, will respond back with the more details and we will try to help.

Anonymous
Not applicable

Hi @SteveDevine ,

Thanks for using Fabric Community,

I cannot find any bug, everything is working properly. I can also find $$FILEPATH at Value itself.

Please find below screenshot:
addcol.png

Destination Lakehouse:
addcol2.png

Can you please confirm your source? Is it DataLake Gen 2 Storage Account?

Hope it is helpful. Please let me know incase of any further queries.

Anonymous
Not applicable

Hi @SteveDevine ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond back with the more details and we will try to help.

Thank You

Hi,

No I still have the problem. My UI does not show the UI but it is Azure Data Lake Storage Gen 2. My pipeline is more parameterised than your example


 

SteveDevine_0-1700310839283.png

 

Anonymous
Not applicable

Hi @SteveDevine ,

At this time, we are reaching out to the internal team to get some help on this .
We will update you once we hear back from them.

In meantime can you please share in which region* you are working?

Thank you

Helpful resources

Announcements
Sept Fabric Carousel

Fabric Monthly Update - September 2024

Check out the September 2024 Fabric update to learn about new features.

Expanding the Data Factory Forums

New forum boards available in Data Factory

Ask questions in Apache Airflow Job and Mirroring.

September Hackathon Carousel

Microsoft Fabric & AI Learning Hackathon

Learn from experts, get hands-on experience, and win awesome prizes.

Sept NL Carousel

Fabric Community Update - September 2024

Find out what's new and trending in the Fabric Community.