Forum Discussion

Sparsh98's avatar
Sparsh98
Regular Visitor
2 years ago
Solved

Daily Append Datasets Refresh Strategy

HI PowerBI Community , 
I am new to PowerBI and need some help in a particular use case . 
One of my client's input comes from a SQL Database and the refresh process set is append . 
So I have a query with me which needs to run daily to get particular day's result . Now my problem is how can I append my  daily query results to my historical data , in order to do visualizations on latest data available.
I have a csv file having historic data with me.
Schedule Refresh works well when the refresh process is replace but how shall i perform it in case of append
I also read about Incremental Refresh but I observed that there should be a date column necessary in data which can be used for start and end date .

Dataflow
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi Sparsh98 ,

    Yes, your data source must have a date/time column if you want to configure incremental refresh.

     

     

    Best regards,
    Community Support Team_Binbin Yu
    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

3 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    Hi Sparsh98 ,

    Please try to configure incremental refresh, Power BI will according to your create policy to refresh the data.

    There are some requirements for set incremental refresh:

    1. Incremental refresh is supported for Power BI Premium, Premium per user, Power BI Pro, and Power BI Embedded models.

    2. Your storage mode is Import

    3. Data source have date/time field

    4. Data source support query folding

     

    For more details, you could read related document: Incremental refresh for semantic models and real-time data in Power BI - Power BI | Microsoft Learn , Configure incremental refresh and real-time data for Power BI semantic models - Power BI | Microsoft Learn

     

    Best regards,
    Community Support Team_Binbin Yu
    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

    • Sparsh98's avatar
      Sparsh98
      Regular Visitor
      2 years ago

      Hi Anonymous, so to be more clear does it means that I need to have a date/time column in my data source compulsorily ?

      • Anonymous's avatar
        Anonymous
        Not applicable
        2 years ago

        Hi Sparsh98 ,

        Yes, your data source must have a date/time column if you want to configure incremental refresh.

         

         

        Best regards,
        Community Support Team_Binbin Yu
        If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.