Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
SamWilliams
Regular Visitor

Pass data pipeline parameter to dataflow gen2

Is it possible to pass a data pipeline parameter (or variable) to a gen2 dataflow?

1 ACCEPTED SOLUTION
miguel
Community Admin
Community Admin

Hi!

Not currently possible, but I've created a new idea so you can cast on vote on it and help us prioritize this work item:

https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=2f761603-a400-ee11-a81c-6045bdb98602

 

Thanks!

View solution in original post

7 REPLIES 7
data_power
Frequent Visitor

@n0elleli Any estimates for that future. More than one year and still missing that feature. By any change any workaround untill that feature is onboard?

n0elleli
Community Admin
Community Admin

Currently, this is not possible, but is a capability that will available in the future. 

I wonder when this future will come

I sure hope so because as things stand now, more than 6 months later, I still cannot control the date range of my on-prem data ingest, which makes no sense as each day that passes, the data grows and grows, so no point in ingesting everything from scratch every single day. 

Have you tried a filter like (pick your date function/span that works for you):

Table.SelectRows(#"Remove Columns", each [Date_Column] >= DateTime.Date(DateTime.LocalNow()) - 1)

No because DFg2 are too expensive in terms of CUs.  So I ended up implementing an incremental ETL inside a pipeline using timestamps from the tables in my LH and comparing to the timestamps in the on-prem DB tables.

miguel
Community Admin
Community Admin

Hi!

Not currently possible, but I've created a new idea so you can cast on vote on it and help us prioritize this work item:

https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=2f761603-a400-ee11-a81c-6045bdb98602

 

Thanks!

Helpful resources

Announcements
Sept Fabric Carousel

Fabric Monthly Update - September 2024

Check out the September 2024 Fabric update to learn about new features.

Expanding the Data Factory Forums

New forum boards available in Data Factory

Ask questions in Apache Airflow Job and Mirroring.

September Hackathon Carousel

Microsoft Fabric & AI Learning Hackathon

Learn from experts, get hands-on experience, and win awesome prizes.

Sept NL Carousel

Fabric Community Update - September 2024

Find out what's new and trending in the Fabric Community.

Top Kudoed Authors