Don't miss your chance to take the Fabric Data Engineer (DP-600) exam for FREE! Find out how by attending the DP-600 session on April 23rd (pacific time), live or on-demand.
Learn moreNext up in the FabCon + SQLCon recap series: The roadmap for Microsoft SQL and Maximizing Developer experiences in Fabric. All sessions are available on-demand after the live show. Register now
I have a pipeline COPY Activity where the source is a Blob Storage file (Data Lake Gen 2) and destination is either a Lakehouse Delta table or Warehouse table. None of the additional columns are being populated.
Tried with $$FILEPATH and various system variables, pipeline parameters
$$FILEPATH does not save properly. When I open the pipeline I see this. The Value has changed to Custom and there is an error message
Hi, what do you need to know?
Hi @Anonymous ,
I am asking in which region you are working?
uk
Hi @Anonymous ,
According to the screenshot you provided above, it seems to it's using dynamic content in the Additional columns, which is not able to see the columns option.
In this case, can you please help to check if the user is able to find the $$FILEPATH by these steps:
Incase if it doesn't help please try to share below information.
I would like to know whether dynamic content was automatically generated or added it
manually?
If it's using the dynamic content, it'll be not able to see the dropdown option.
I would also like to know what connector you are using in this case?
Hi @Anonymous ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet.
In case if you have any resolution please do share that same with the community as it can be helpful to others.
Otherwise, will respond back with the more details and we will try to help.
Hi @Anonymous ,
Thanks for using Fabric Community,
I cannot find any bug, everything is working properly. I can also find $$FILEPATH at Value itself.
Please find below screenshot:
Destination Lakehouse:
Can you please confirm your source? Is it DataLake Gen 2 Storage Account?
Hope it is helpful. Please let me know incase of any further queries.
Hi @Anonymous ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others. Otherwise, will respond back with the more details and we will try to help.
Thank You
Hi,
No I still have the problem. My UI does not show the UI but it is Azure Data Lake Storage Gen 2. My pipeline is more parameterised than your example
Hi @Anonymous ,
At this time, we are reaching out to the internal team to get some help on this .
We will update you once we hear back from them.
In meantime can you please share in which region* you are working?
Thank you
Experience the highlights from FabCon & SQLCon, available live and on-demand starting April 14th.
If you have recently started exploring Fabric, we'd love to hear how it's going. Your feedback can help with product improvements.
| User | Count |
|---|---|
| 4 | |
| 2 | |
| 2 | |
| 2 | |
| 1 |