Forum Discussion

jones_lilly's avatar
jones_lilly
Frequent Visitor
4 years ago
Solved

Dataset refresh query

Hi there, 

 

When I have a scheduled refresh for a dataset that is connected to a SQL database (Set to 'Import data'), does this import the entire SQL table datasource connection for each refresh? So, if my SQL table grows over time, each refresh will pull in all the data in the data source?

 

Thanks!

Need Help
  • Burningsuit's avatar
    Burningsuit
    4 years ago

    Hi jones_lilly 

    Yes, you are correct. Unless you have built any filters in with Power Query your refresh will pull the entire SQL table in on each refresh, replacing what was there. Thus if you add records to the SQL table that data will be imported with all the other data at the next refresh.

    Hope this helps

    Stuart

2 Replies

  • Burningsuit's avatar
    Burningsuit
    Resident Rockstar
    4 years ago

    Hi jones_lilly 

    Yes, you are correct. Unless you have built any filters in with Power Query your refresh will pull the entire SQL table in on each refresh, replacing what was there. Thus if you add records to the SQL table that data will be imported with all the other data at the next refresh.

    Hope this helps

    Stuart

    • Tutu_in_YYC's avatar
      Tutu_in_YYC
      Super User
      4 years ago

      jones_lilly You can add filters in Power Query to the query to pull e.g last 3 years data, if you dont want your dataset to grow too big and take forever to refresh.