Enable a built-in SCD2 update option in Copy Job. When using CDC sources like Delta CDF, Copy Job should automatically manage validity dates (valid_from, valid_to) and current row flags. This would...
Not sure if I should add this here or as it's own idea. In addition to creating SCD2 from CDC, which is fantastic BUT is limited by the retention of the CDC log (you can never reload and maintain the same history). It would be fantastic if there was an option to create an SCD2 from existing audit tables. E.g. have ACTION_TIME, ACTION_TYPE (I, U, D) or equivalent columns. The output would be the same as the current SCD2 preview but would allow it to be used on tables with full, reloadable history. Provide PK / BK, specify the action time or equivalent column, specify the insert, update or delete column .... job done.
