Pass data pipeline parameter to dataflow gen2

[SamWilliams]

Is it possible to pass a data pipeline parameter (or variable) to a gen2 dataflow?

[data_power]

@n0elleli Any estimates for that future. More than one year and still missing that feature. By any change any workaround untill that feature is onboard?

[n0elleli]

Currently, this is not possible, but is a capability that will available in the future. 

[Marusyk]

I wonder when this future will come

[Element115]

I sure hope so because as things stand now, more than 6 months later, I still cannot control the date range of my on-prem data ingest, which makes no sense as each day that passes, the data grows and grows, so no point in ingesting everything from scratch every single day. 

[donovan-bergin]

Have you tried a filter like (pick your date function/span that works for you):

Table.SelectRows(#"Remove Columns", each [Date_Column] >= DateTime.Date(DateTime.LocalNow()) - 1)

[Element115]

No because DFg2 are too expensive in terms of CUs.  So I ended up implementing an incremental ETL inside a pipeline using timestamps from the tables in my LH and comparing to the timestamps in the on-prem DB tables.

[miguel · Accepted solution]

Hi!

Not currently possible, but I've created a new idea so you can cast on vote on it and help us prioritize this work item:

https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=2f761603-a400-ee11-a81c-6045bdb98602

Thanks!