Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
1 year ago

Incremental Refresh is not working in Production workspace

I have a report with incremental refresh and published it to test and then deployed in Prod workspace using deployment pipeline. I have scheduled the reports weekly once in test and prod. Full load i...
Need Help
pallavi_r's avatar
pallavi_r
Icon for Super User rankSuper User
1 year ago

Hi Anonymous ,

As lbendlin has mentioned, your partitions are very small. Set it to Monthly.

Couple of other checks:

1. Is query folding happening? you can check this by right clicking on the dataset. view native query will be enabled.

2.The data parameter for range start and range end should not be same as detect data changes date.

3.If all these are correct, then do a full refresh with less data. You can utilize view with date range for the same 

4.Once full refresh is done, do partition wise refresh using process data.

5.Precess Recalc 

6.When you achieve success till step 5, these are step by step process. then try incremental refresh it should work.

Thanks,

Pallavi

  • Anonymous's avatar
    Anonymous
    Not applicable
    1 year ago

    Hi Pallavi,

     

    Thanks for your reply.

     

    1. I am using Azure Databricks, so query folding is not applied.

    2. Range start I gave Nov1st 2024, and range end I gave as Dec1st 2024. So we have enough gap.
    3. I publsihed my report after setting incremental refresh. I gave 7days for refresh period.
    4. Then I did full refresh manually in the prod after deploying it from test using deployment pipeline.
    5. Scheduled refresh is happend on 17th Dec, it got completed without any error but didn't pickup records.
    then I tried refreshing the last 7days data using SSMS. Issue got fixed here. but we don't know the root cause and not sure if it pick up the records in next scheduled refresh or not. So my manager is expecting a root cause for this. So I have raised a case with Microsoft. Case 2412181420002119