Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
4 years ago

Dataflow Incremental Refresh Update Specific Partitions

I understand how a specific partition can be refreshed in Power BI Dataset using SSMS or Tabular Editor via the XLMA Endpoints.  Thanks GuyInACube  My question is how can I refresh specific partit...
Dataflow
Anonymous's avatar
Anonymous
Not applicable
4 years ago

v-janeyg-msft 

This is the error message using SQL Database connection:

And there are only two visible options for the Analysis Services connector:

 

  • Anonymous's avatar
    Anonymous
    Not applicable
    4 years ago

    Thanks for the link, v-janeyg-msft 
    The Incremental Dataflow sits between an initial Dataflow and the final Datasets.  The Initial Dataflow is import a JSON file and transforms it into a couple of Tables.  These initial dataflow tables are limited to 30 days of activity.  The Incremental Dataflow is working as designed.  Each day is reads the last 30 days of activity, but only updates the last 14 days.   My Incremental load contains data back through Oct 2021.  If was hoping to have the flexibity to update some of the old partitions to add, remove or replace them.

    • v-janeyg-msft's avatar
      v-janeyg-msft
      Community Support
      4 years ago

      Anonymous 

       

      What ‘s your refresh history? Does your json file support query folding?

  • Anonymous's avatar
    Anonymous
    Not applicable
    4 years ago

    v-janeyg-msft 
    It is another Dataflow in the same workspace.  The JSON file is loading into a Standard Dataflow.  The Incremental Dataflow is reading from this initial Dataflow.  Are both the Standard and Incremental Dataflows not considered "Azure Data Lake Storage".  Would the Workspace need to be configured to use Gen 2 storage? 

     

    Or do both the dataflow need to be switched to "Enhanced Compute Engine" (I thought be default this would be on because the Dataflows are linked?):

     



      • Anonymous's avatar
        Anonymous
        Not applicable
        4 years ago

        thank for your help v-janeyg-msft - I think will need to close this and leave it as unsolved.  Perhaps the documentation on the following page needs to updating:
        Using incremental refresh with dataflows - Power Query | Microsoft Docs

        I believe the sentence "After XMLA-endpoints for Power BI Premium are available, the partition become visible."  This is true for Datasets (i.e. because they are Analysis Services Tabular Databases, but it is not true for Dataflow.

         

        Dataflows would be JSON and CSV files in the Power BI's Azure Data Store.  These can't be accessed using the XMLA Endpoints because it is not analysis service object.

        Perhaps the documentation needs to be updated by: bensack , @DCtheGeek and @steindav

        to say that this is not possible or to explain how it is possible.