Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

The ultimate Microsoft Fabric, Power BI, Azure AI & SQL learning event! Join us in Las Vegas from March 26-28, 2024. Use code MSCUST for a $100 discount. Register Now

Reply
crln-blue
Post Patron
Post Patron

Odata incremental refresh not appending data

Hello everyone!

I have tables where my source is through odata feed (from sap). My odata source only provides delta data, meaning, data that were just changed one day ago. Therefore, the output changes everyday. 

 

I've looked through the docs and made RangeStart and RangeEnd date time parameters. I loaded my Odata and filtered the my changed date field with the RangeStart and RangeEnd parameters.

let
    url = "https://fiori----sap/opu/odata/sap/----",
    options = 
    [
        Headers = [
            #"sap-client" = ----,
            #"Authorization" = "Basic " & ----
        ]
    ],
    Source = OData.Feed(url, null, options),
    #"Filtered Rows" = Table.SelectRows(Source, each [changed_date] >= RangeStart and [changed_date] <= RangeEnd)
in
    #"Filtered Rows"

I also set up the incremental settings on the Power BI Desktop:

crlnblue_0-1701363187426.png

And then published it to Service.

When I the scheduled refresh runs, it does not append data (which is what is expected with incremental refresh). Instead, it replaces with a new data - it deletes the first data load and every time it refreshes, it deletes and places new data.

 

I followed the docs but I'm not getting the incremental refresh I'm supposed to have.

 

What would be the solution for this? There are no filters on my odata url because the odata url already provides data from the past day.

 

This has been bugging me for weeks. 😢

Advanced thank you for the help!

2 REPLIES 2
amitchandak
Super User
Super User

@crln-blue , It should delete data for the last 10 days and again append data for the last 10 days.

 

Can you make sure the step where you have given a filter for data range was folding? If not, It might bring in full data and then do incremental

Hmm I'm not really sure if the step where I put the filter is folding. I just followed the docs. However, it isnt working.

Helpful resources

Announcements
Fabric Community Conference

Microsoft Fabric Community Conference

Join us at our first-ever Microsoft Fabric Community Conference, March 26-28, 2024 in Las Vegas with 100+ sessions by community experts and Microsoft engineering.

February 2024 Update Carousel

Power BI Monthly Update - February 2024

Check out the February 2024 Power BI update to learn about new features.

Fabric Career Hub

Microsoft Fabric Career Hub

Explore career paths and learn resources in Fabric.

Fabric Partner Community

Microsoft Fabric Partner Community

Engage with the Fabric engineering team, hear of product updates, business opportunities, and resources in the Fabric Partner Community.

Top Solution Authors