Forum Discussion
Incremental refresh with several Appended Dataflows
I have found the solution! First I’ve created three queries from the new Dataflow connector.
Then I’ve added the filtering with RangeStart and RangeEnd parameters in each query.
I’ve checked and the query folding is taking place in all queries. Then I’ve disable loading into model for the three queries and created a forth query (FactTable) which Appends the three. Then I filtered this table again with the RangeStart and RangeEnd parameters (this filter is redundant but we need it, otherwise the model will not allow us to set incremental refresh policy). On this step the query folding is lost but it doesn’t matter since we already append the filtered data from the previous, folded queries. The last step is of course to set the incremental refresh policy and publish. This can also be implemented for different data sources, for example - SQL Server and Dataflow. Hope someone can also benefit from this solution.
I have found the solution! First I’ve created three queries from the new Dataflow connector.
Then I’ve added the filtering with RangeStart and RangeEnd parameters in each query.
I’ve checked and the query folding is taking place in all queries. Then I’ve disable loading into model for the three queries and created a forth query (FactTable) which Appends the three. Then I filtered this table again with the RangeStart and RangeEnd parameters (this filter is redundant but we need it, otherwise the model will not allow us to set incremental refresh policy). On this step the query folding is lost but it doesn’t matter since we already append the filtered data from the previous, folded queries. The last step is of course to set the incremental refresh policy and publish. This can also be implemented for different data sources, for example - SQL Server and Dataflow. Hope someone can also benefit from this solution.
Hello, I use in a dataset some data flow, such flows are already configured for incremental update in the power bi service.
Only that it would be necessary to configure the incremental update in the set.
I'm finding several difficulties for this, would it be possible for you to help me?
I ran it exactly as mentioned in your post, but without success.