Forum Discussion
Insert data from two tables into a third table weekly
Is there a way to insert data from two tables into another manually created snapshot table and do this on a weekly basis? I don't want previous weeks to be deleted.
Coming from the SQL Server side of things, I could do this with a stored procedure that runs an INSERT statement each week from a SQL Job into a SQL table.
I'm sure there's an obvious way to do this in Power BI, so if anyone can point me in the right direction that would be very appreciated.
No. When Power BI refreshes, it is a "wipe all data, and reload" process. You would need a database or other process to manage data. Power BI isn't set to maintain data that no longer exists in other places - i.e. creating snapshots.
There is an interesting article here about how to work around this with an incremental refresh, but I wouldn't use this in production. It isn't supported, and republishing the PBIX will wipe out the history. Chris Webb's BI Blog: Keep The Existing Data In Your Power BI Dataset And Add New Data To It Using Incremental Refresh Chris Webb's BI Blog (crossjoin.co.uk)
2 Replies
- edhansCommunity Champion
No. When Power BI refreshes, it is a "wipe all data, and reload" process. You would need a database or other process to manage data. Power BI isn't set to maintain data that no longer exists in other places - i.e. creating snapshots.
There is an interesting article here about how to work around this with an incremental refresh, but I wouldn't use this in production. It isn't supported, and republishing the PBIX will wipe out the history. Chris Webb's BI Blog: Keep The Existing Data In Your Power BI Dataset And Add New Data To It Using Incremental Refresh Chris Webb's BI Blog (crossjoin.co.uk)- arock-wellResponsive Resident
Thanks edhans! I was trying to wrap my head around this, but thanks for letting me know. Now back to SQL Server to complete this.