March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early bird discount ends December 31.
Register NowBe one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now
Is it possible to pass a data pipeline parameter (or variable) to a gen2 dataflow?
Solved! Go to Solution.
Hi!
Not currently possible, but I've created a new idea so you can cast on vote on it and help us prioritize this work item:
https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=2f761603-a400-ee11-a81c-6045bdb98602
Thanks!
@n0elleli Any estimates for that future. More than one year and still missing that feature. By any change any workaround untill that feature is onboard?
Currently, this is not possible, but is a capability that will available in the future.
I wonder when this future will come
I sure hope so because as things stand now, more than 6 months later, I still cannot control the date range of my on-prem data ingest, which makes no sense as each day that passes, the data grows and grows, so no point in ingesting everything from scratch every single day.
Have you tried a filter like (pick your date function/span that works for you):
Table.SelectRows(#"Remove Columns", each [Date_Column] >= DateTime.Date(DateTime.LocalNow()) - 1)
No because DFg2 are too expensive in terms of CUs. So I ended up implementing an incremental ETL inside a pipeline using timestamps from the tables in my LH and comparing to the timestamps in the on-prem DB tables.
Hi!
Not currently possible, but I've created a new idea so you can cast on vote on it and help us prioritize this work item:
https://ideas.fabric.microsoft.com/ideas/idea/?ideaid=2f761603-a400-ee11-a81c-6045bdb98602
Thanks!
March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!
User | Count |
---|---|
6 | |
5 | |
4 | |
1 | |
1 |
User | Count |
---|---|
15 | |
13 | |
11 | |
7 | |
6 |