Forum Discussion
Solved
Pass data pipeline parameter to dataflow gen2
Is it possible to pass a data pipeline parameter (or variable) to a gen2 dataflow?
Hi!
Not currently possible, but I've created a new idea so you can cast on vote on it and help us prioritize this work item:
https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=2f761603-a400-ee11-a81c-6045bdb98602
Thanks!
Have you tried a filter like (pick your date function/span that works for you):
Table.SelectRows(#"Remove Columns", each [Date_Column] >= DateTime.Date(DateTime.LocalNow()) - 1)
No because DFg2 are too expensive in terms of CUs. So I ended up implementing an incremental ETL inside a pipeline using timestamps from the tables in my LH and comparing to the timestamps in the on-prem DB tables.