dataset parameters

[SARAVAB_1]

In ADF we have dataset and dataset parameters, I want to know what is the replacement/alternative for the dataset in fabric environment so that i can able to use the dataset properties in pipelines

In Copy Activity we will be having I want to append or upsert the values in Lake House , so that only newly added data get copied into my destination. Can You please give me some suggestions to do this in my pipeline

The screenshot for the regular Azure Data factory

The screenshot for the Fabric Data factory

[ajarora · Accepted solution]

Hello

In Fabric, the datasets prpoerties are part of the pipeline itself, but all those properties are still parameterizable. Which specific property are you looking to parameterize and unable to do so in Fabric pipelines ?

Secondly, if your sink is lakehouse, and you are looking to UPSERT the new data instead of always appending or truncating, then currently there is no way, however this feature is in progress. Please go ahead and vote on this idea: https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=87f3d168-6022-ee11-a81c-6045bdc01ce4

And if you are blocked, send me a private message I will be happy to guide you further.

[prerna0708]

Hello,

I want to copy data from excel file to a table in lakehouse, i want to add dynamic content in the field sheet name but for that i need to create dataset parameter called sheet name.

I tried to put it using @activity but this is recognized only inside the pipeline, but not dataset. Can you please help me how to add dataset parameter?

This is where I want to add dynamic content: