fbcideas_migusr
7 years agoNew Member
Status:
Needs Votes
Incremental Refresh with Unique Key Column check
Along with Date Time stamp, there needs to be option to select a Unique/primary Key column too. Else we are only appending data leading to duplication, not checking if a Key was already inserted in the past. More Explanation: Currently incremental refresh works for the data that was inserted based on DateTime stamp, lets say last 10 days. It does not take into consideration the Primary Key that might have been inserted in the past. Eg: Lets say a "Sales Order" was created 3 months ago with a Status "Open", but only today its "Status" was changed from "Open" to "Shipped". Since I am only looking rows modified in last 10 days data (for incremental refresh), a new Sales Order row gets inserted into my Dataset causing my "Sales Order" table to be duplicated. How can we avoid this? Ideally along with the Datetime stamp, there needs to be a option where we specify the Unique Key column too. If incremental refresh contains any of the Unique Keys loaded in the past, they need to be deleted too and reinserted. Dataset will look like this: ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ Sales Order | Status------| LastModifiedDateTime ~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~~ SO0000001 | Open | 10-Dec-2018 12:00:00AM SO0000001 | Shipped | 10-Jul-201812:00:00AM
2 Comments
- TmullinsNew Member
Completely agree - I needed this feature yesterday.
Why this was not part of the original design completely baffles me.
- fbcideas_migusrNew MemberStatus added:Needs Votes
Recent ideas
Deployment Pipelines - Remember selected stage
Every time we go into a deployment pipeline, it defaults to selecting the Development stage. I believe that it would be very rare to have a user select the Development stage. It would be helpful if d...PeterDaniels4 hours agoAdvocate IINew1View0likes0CommentsDisable auto-restore previous session's tabs in new Fabric sessions
Description: Since a recent update, starting a new Fabric session — for example by opening Fabric in a new browser tab — automatically reopens all the item tabs that were left open from a previous s...MathieuVr10 hours agoFrequent VisitorNew56Views5likes1CommentExported PDF from PowerBI to not have any indents/borders
Currently, using the "Export to PDF" option in PowerBI results in two consistently buggy results: A white border/indent is generated, increasing the size of the page from 8.5x11 to 9x11.5 Sometime...EliShalev14 hours agoNew MemberNew12Views0likes0CommentsAdding a Container for Logical Grouping of Activities in Data Pipelines
Dear Team, I would like to propose a feature enhancement for Data Pipelines in Microsoft Fabric that allows the logical grouping of activities into a container. This container would serve to: Im...lukas_karlovsky14 hours agoNew MemberPlanned876Views15likes5Comments