Forum Discussion
Refresh only update new data from Oracle database with SQL import
Super UserAnonymous , Have you tried the incremental Laod or dax append method ?
DAX append
https://blog.crossjoin.co.uk/2020/04/13/keep-the-existing-data-in-your-power-bi-dataset-and-add-new-data-to-it-using-incremental-refresh/
https://www.thebiccountant.com/2017/01/11/incremental-load-in-powerbi-using-dax-union/
I have read some:
- Incremental refresh for SQL source requires removing all SQL statement query and import data from database table. But as I mentioned I don't just load a table from Oracle, I use SQL (JOIN/PIVOT/UNION) to create a new one based on Oracle database. So I can't finish step 4 of this instruction: https://www.mssqltips.com/sqlservertip/6476/power-bi-incremental-refresh-for-sql-sources/
- About Dax append (Union), you have to import both old data and new data then Union them. It will double the data, which is millions rows, and make the PBI file become larger.
I'm just thinking about create a new table in Oracle dtb and just load that table to PBI then do Incremental refresh. But there is a problem: I have to transform and load data to the new table whenever data of new Snapshotdate is loaded to the original table, it takes time and consume more space in database as well.
So is there any possible way to do this?