Query Previous Day, Keep Historic Data

I need to build a report that queries multiple, large tables. The report must be updated daily, so it isn't feasible to query the entire then drill down. For example, I would like Power Query to the database to have a "WHERE [date column] >= sysdate-1". I just need the ability to keep appending the data without creating new datasets for each day. Is it possible to only query the previous day, but maintain the historic data in the dataset? Incremental refresh seems like it might solve this issue, but I'm not entirely certain.