Append new query data to static data

[MrBirch]

Hi Team,

Applogies in advance data is not my first language.

I've got a problem, I need to manually refresh a modest dataset (10-15M rows) every day and publish to a Workspace for others to consume.

I can only connect to my source using "import". This means I can't use any of the incremental refresh options or schedule updates.

The data set that I connect to only changes 10% each day, I can clearly identify which lines need to be updated. to speed things up I've tried to create 2 versions of the query, 1 filters out the static data and the other filters out the dynamic data. I've tried to set the set the dynamic query to Update on Refresh and then append the two queries.  When I've tired this it seems to try and update the static data query as well. so I don't save any time.

Any ideas?  

thanks in advance.

[v-jingzhang]

Hi @MrBirch 

For the static data query, you can right click on it and uncheck the Include in report refresh option. In this way, it will not be refreshed next time. 

For more details about this option, please refer to Managing query refresh in Power BI 

Hope this helps. 

Best Regards,
Community Support Team _ Jing
If this post helps, please Accept it as Solution to help other members find it.

[some1else]

I'm facing the same "problem".

Today I found this (have yet to try it) solution: Solved: Execute Table.Combine between tables - Microsoft Power BI Community

In your case after importing you can add a custom column with the value you want to determine if it needs updating or not.