Loading only newest data

[qmestu]

Hi,

The dataset used in one of my reports is a combination of several tables, each one of them with a different source (mostly APIs, but some excel files). I would like to know if there is a way that i can use to load only the newest set of data from each of these sources. I read about incremental refresh, but i'm not sure that this can be applied in my case, in which there are several sources that feed my fact table.

Thanks.

[Anonymous]

Hi @qmestu ,

Yes, you can use incremental refresh to load only the newest set of data from each of these sources. To use incremental refresh, you need to define the refresh policy for each table in your dataset. You can define the refresh policy based on a date column in your table. Power BI will then only load the data that is newer than the last refresh. You can also define the retention policy for your data, which determines how long the data will be kept in the dataset

To use incremental refresh with multiple sources, you can create a separate table for each source and define the refresh policy for each table. You can then combine the tables into a single fact table using Power BI's relationship feature

More details: Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Learn

If it does not help, please provide more details.

Best Regards
Community Support Team _ Rongtie

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.