Reply
SARAVAB_1
Frequent Visitor

dataset parameters

In ADF we have dataset and dataset parameters, I want to know what is the replacement/alternative for the dataset in fabric environment so that i can able to use the dataset properties in pipelines

 

In Copy Activity we will be having I want to append or upsert the values in Lake House , so that only newly added data get copied into my destination. Can You please give me some suggestions to do this in my pipeline

 

The screenshot for the regular Azure Data factory

 

SARAVAB_1_0-1689779802642.png

 

The screenshot for the Fabric Data factory

 

SARAVAB_1_1-1689779838109.png

 

 

1 ACCEPTED SOLUTION
ajarora
Microsoft Employee
Microsoft Employee

Hello

 

In Fabric, the datasets prpoerties are part of the pipeline itself, but all those properties are still parameterizable. Which specific property are you looking to parameterize and unable to do so in Fabric pipelines ?

Secondly, if your sink is lakehouse, and you are looking to UPSERT the new data instead of always appending or truncating, then currently there is no way, however this feature is in progress. Please go ahead and vote on this idea: https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=87f3d168-6022-ee11-a81c-6045bdc01ce4

And if you are blocked, send me a private message I will be happy to guide you further.

View solution in original post

2 REPLIES 2
ajarora
Microsoft Employee
Microsoft Employee

Hello

 

In Fabric, the datasets prpoerties are part of the pipeline itself, but all those properties are still parameterizable. Which specific property are you looking to parameterize and unable to do so in Fabric pipelines ?

Secondly, if your sink is lakehouse, and you are looking to UPSERT the new data instead of always appending or truncating, then currently there is no way, however this feature is in progress. Please go ahead and vote on this idea: https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=87f3d168-6022-ee11-a81c-6045bdc01ce4

And if you are blocked, send me a private message I will be happy to guide you further.

Hello,

 

I want to copy data from excel file to a table in lakehouse, i want to add dynamic content in the field sheet name but for that i need to create dataset parameter called sheet name.

 

I tried to put it using @activity but this is recognized only inside the pipeline, but not dataset. Can you please help me how to add dataset parameter?

 

This is where I want to add dynamic content: 

prerna0708_0-1722951772408.png

 

avatar user

Helpful resources

Announcements
Join our Fabric User Panel

Join our Fabric User Panel

This is your chance to engage directly with the engineering team behind Fabric and Power BI. Share your experiences and shape the future.

June FBC25 Carousel

Fabric Monthly Update - June 2025

Check out the June 2025 Fabric update to learn about new features.

June 2025 community update carousel

Fabric Community Update - June 2025

Find out what's new and trending in the Fabric community.

Top Solution Authors (Last Month)
Top Kudoed Authors (Last Month)