Forum Discussion
How to handle huge data coming from rest API.
For Incremental Refresh to work you need two parameters RangeStart and RangeEnd. You can then define a Incremental Refresh Policy, specifying a time window for active partitions that will request data each refresh, and a archive window, that will not request data. Over time the active partitions will fall into the archive window. This partitions are only created once the model is published to the Power BI service. Each partition will have a start and end date that will be injected via the RangeStart and RangeEnd parameters. Therefore you need to RangeStart and RangeEnd parameters setup to filter data in the table you want incremental refresh applied too. Since you are calling the API the RangeStart and RangeEnd will likely just be appended to the URL string for the API or in the request body
Does the API have a parameter to specify a date range to return?
Hello Deku,
Thank you for your response.
Currently, the API does not support a date range filter, but we have the flexibility to add it. However, if we implement this, how can we efficiently archive older data while ensuring that the refresh process works seamlessly in Power BI? Additionally, what would be the best approach to set up and manage the incremental refresh in this scenario?
Would appreciate any guidance on this.
Thanks!
For Incremental Refresh to work you need two parameters RangeStart and RangeEnd. You can then define a Incremental Refresh Policy, specifying a time window for active partitions that will request data each refresh, and a archive window, that will not request data. Over time the active partitions will fall into the archive window. This partitions are only created once the model is published to the Power BI service. Each partition will have a start and end date that will be injected via the RangeStart and RangeEnd parameters. Therefore you need to RangeStart and RangeEnd parameters setup to filter data in the table you want incremental refresh applied too. Since you are calling the API the RangeStart and RangeEnd will likely just be appended to the URL string for the API or in the request body
Hi vikramkumawat ,
I wanted to check if you had the opportunity to review the information provided. Please feel free to contact us if you have any further questions. If my response has addressed your query, please accept it as a solution so other members can easily find it.
Thank you.Hi vikramkumawat ,
I wanted to check if you had the opportunity to review the information provided by Deku . Please feel free to contact us if you have any further questions. If my response has addressed your query, please accept it as a solution and give a 'Kudos' so other members can easily find it.
Thank you.
