Dataset refresh query

[jones_lilly]

Hi there, 

When I have a scheduled refresh for a dataset that is connected to a SQL database (Set to 'Import data'), does this import the entire SQL table datasource connection for each refresh? So, if my SQL table grows over time, each refresh will pull in all the data in the data source?

Thanks!

[Burningsuit · Accepted solution]

Hi @jones_lilly 

Yes, you are correct. Unless you have built any filters in with Power Query your refresh will pull the entire SQL table in on each refresh, replacing what was there. Thus if you add records to the SQL table that data will be imported with all the other data at the next refresh.

Hope this helps

Stuart

[Tutu_in_YYC]

@jones_lilly You can add filters in Power Query to the query to pull e.g last 3 years data, if you dont want your dataset to grow too big and take forever to refresh.