Forum Discussion

skipper's avatar
skipper
Frequent Visitor
5 years ago
Solved

How to append and store streaming data?

I am developing Twitter analysis for my client. I am able to fetch the data from user timeline.   1. Currently I am having a table that can store 200 records 2. every refresh it fetches the data a...
  • V-lianl-msft's avatar
    5 years ago

    Hi skipper ,

     

    You can try incremental refresh.

    Table data is filtered by using Power Query date/time parameters with the reserved, case-sensitive names RangeStart and RangeEnd.

    When published to the service, with the first refresh operation, the service creates incremental refresh and historical partitions based on incremental refresh policy settings, and then overrides the parameter values to filter and query data for each partition based on date/time values for each row.

    This blog may help you:

    https://sqldusty.com/2020/05/20/power-bi-incremental-refresh-with-web-api-data-source/ 

     

    Best Regards,
    Liang
    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.