Incremental Refresh where Data is HANA CV with Input Parameter

[Anonymous]

Hi Team,

I have been working on a Power BI Report on top of an enormous interval data set. The data source is a HANA CV with an Input parameter on IntervalFromDate and IntervalToDate. To avoid daily full refresh of such a vast dataset I followed the steps suggested by MS to configure the Incremental Refresh of the data set on a ChangeDateTime field which is different than the field used by InputParametrs to restrict the data. 

After the report got published to Power BI Service, my report is not getting updated with the historical data or archived data as per the configuration defined during incremental refresh.  I suspect this is because I have an Input parameter in the CV. Have anyone experienced this before?

Any help would be highly appreciated. 

[Anonymous]

Yes, I have everything as expected. But here is what I observed I have 2 such reports.

The first one is having no variables in the CV and the other one has a variable in the CV. The variable is used to filter values on the same timestamp which is used for an incremental refresh.

First Report is working fine with incremental refresh however same is not true with the second report. 

[Anonymous]

Hi @Anonymous ，

So what you're saying is that the first report without virables can successfully refresh, but the second report with virables cannot?

At the same time , I remembered a critical question, did you successfully configure your incremental refresh on power bi desktop?

Because when you configure it successfully on desktop and do the initial refresh manually in service with the same success, it proves that the incremental refresh has been applied. So I have to make sure that your configuration in desktop is valid.

Best regards,

Community Support Team Selina zhu

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

[Anonymous]

Yes, the Incremental policy configuration is correct.

The first Report can refresh the data while the other report with variables only picks the data based on the date entered on the variables (hardcoded on the desktop). 

[Anonymous]

Hi @Anonymous ,

I noticed this statement you said：

So actually I think the report with the variable is also successfully incrementally refreshed, it's just that because of the presence of this filter variable, the final displayed results have this filter applied, resulting in a difference in time. If it's convenient, maybe you can try changing the variable and check the results to see if there is a change.

Best regards,

Community Support Team Selina zhu

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

[Anonymous]

I was able to resolve the issue myself.  Incremental refresh is working fine. The last piece of the puzzle left is I have set the IR for 36 months based on my DateTime field. So Now I have data from Aug 2019 till Aug 2022. I believe when IR runs on the 1st Sept then data for the Aug 2019 will be dropped automatically from PBI Dataset. Right?

[Anonymous]

Yes, I think the issue was with the query folding. however, now I have another concern what will happen if we change any cold data which has been archived? Will Power BI be able to overwrite the existing data or will it throw errors or aggregate measures?  

[Anonymous]

Hi @Anonymous ,

If you can, I would rather recommend that you reconnect the data and import it into desktop, then go through the step-by-step configuration of incremental refresh.

If this is more problematic, you can try to find out what is preventing you from query folding and go about it.

some information related to query folding you can view this doc:

Query folding - Power Query | Microsoft Docs

Best regards,

Community Support Team Selina zhu

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

[Anonymous]

Hi @Anonymous ,

I don’t think your Input parameter will affect incremental refresh.

Have you determined that the incremental refresh configuration in power bi desktop was successful? In particular, the basic requirements needed to configure incremental refreshes, such as date columns, date parameter settings, and query folding conditions.

If you have successfully configured it, then after publishing to the service you need to do a manual refresh first, during which the incremental refresh will be started.

You can refer to the two docs for more information about incremental refresh.

Incremental refresh for datasets and real-time data in Power BI - Power BI | Microsoft Docs

Configure incremental refresh and real-time data for Power BI datasets - Power BI | Microsoft Docs

Best regards,

Community Support Team Selina zhu

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly