Forum Discussion
Where to modify destination from replace to append
Hi there,
I am busy following this method so I can do incremental refresh to a Lakehouse:
https://www.azureguru.net/datalake-incremental-updates-using-microsoft-fabric-dataflow-gen2
At one point, it says you should "Go back to the lakehouse destination in the DataFlow and change the destination target from New Table to Existing table and select SalesOrderHeader table from the lakehouse." Later it says to change the update method to append.
On my DataFlow, I cannot see anywhere to change the destination. I can see what the destination is and that the update method is replace, but I absolutely cannot find anywhere to modify this!
Any suggestions! It's driving me nuts!
Thanks
Thanks
Hi all, in case anyone in future experiences this issue, you need to do the following:
- Remove the default destination. You can delete it.
- Add a new default destination. Don't choose the default lakehouse you are in - instead pick from the options below, one of which says "Lakehouse".
- Follow the process. At one point, you get the option to choose a destination target. Here you must pick from New Table or Existing Table. Pick Existing Table. Drill down in the display options to find the table you wish to use. Click next.
- You now get given the option to Append or Replace. Obviously you pick Append at that point and there you go! Click Save settings and you will now append rather than replace the data in the table.
- Remove the default destination. You can delete it.
5 Replies
- NandanHegdeSuper User
Click on the settings of the lakehiuse destination to update the properties :
- DataSkillsResolver I
Unfortunately, I don't have that option. I only have the information icon, and when I click it, there is no editable option to change this.
⬇️
And I cannot do anything regarding the default destination except remove it.
- miguelCommunity Admin
It appears that you're using default destination which means that you created this Dataflow from within a specific expreience (such as a Lakehouse). The article below explains in more detail the fixed behaviors that you get when using default destination:
Dataflow Gen2 default destination - Microsoft Fabric | Microsoft Learn
- DataSkillsResolver I
Hi all, in case anyone in future experiences this issue, you need to do the following:
- Remove the default destination. You can delete it.
- Add a new default destination. Don't choose the default lakehouse you are in - instead pick from the options below, one of which says "Lakehouse".
- Follow the process. At one point, you get the option to choose a destination target. Here you must pick from New Table or Existing Table. Pick Existing Table. Drill down in the display options to find the table you wish to use. Click next.
- You now get given the option to Append or Replace. Obviously you pick Append at that point and there you go! Click Save settings and you will now append rather than replace the data in the table.
- v-menakakotaCommunity Support
Hi DataSkills ,
We really appreciate your efforts and for letting us know the update on the issue.
Please continue using fabric community forum for your further assistance.
If this is the solution that has worked for you please accept your reply as solution so as to help other community members who may face similar issue in the future.
Thank you,
Menaka Kota.
- Remove the default destination. You can delete it.