Forum Discussion
Append new query data to static data
Hi Team,
Applogies in advance data is not my first language.
I've got a problem, I need to manually refresh a modest dataset (10-15M rows) every day and publish to a Workspace for others to consume.
I can only connect to my source using "import". This means I can't use any of the incremental refresh options or schedule updates.
The data set that I connect to only changes 10% each day, I can clearly identify which lines need to be updated. to speed things up I've tried to create 2 versions of the query, 1 filters out the static data and the other filters out the dynamic data. I've tried to set the set the dynamic query to Update on Refresh and then append the two queries. When I've tired this it seems to try and update the static data query as well. so I don't save any time.
Any ideas?
thanks in advance.
2 Replies
- some1elseHelper II
I'm facing the same "problem".
Today I found this (have yet to try it) solution: Solved: Execute Table.Combine between tables - Microsoft Power BI Community
In your case after importing you can add a custom column with the value you want to determine if it needs updating or not.
- v-jingzhangCommunity Support
Hi MrBirch
For the static data query, you can right click on it and uncheck the Include in report refresh option. In this way, it will not be refreshed next time.
For more details about this option, please refer to Managing query refresh in Power BI
Hope this helps.
Best Regards,
Community Support Team _ Jing
If this post helps, please Accept it as Solution to help other members find it.