I understand how a specific partition can be refreshed in Power BI Dataset using SSMS or Tabular Editor via the XLMA Endpoints. Thanks GuyInACube My question is how can I refresh specific partition for Power BI Dataflow. The XLMA Endpoint connect will only show the Datasets because these are SSAS Tabular Model. The Dataflow are not SSAS. They are objects in the Datalake. How can I refresh the partitions between 5 Years and 14 Days without deactivating and re-activating the Incremental Load?

I believe this is required feature for many.In my case, I have huge table loaded into my dataflow and would like to process the partitions seperately when I need reprocess all the partitions.Only option now is loading all of the partitions sequentally and then incrementally after that.Can someone confirm that there is no way of processing dataflow partitions sepperately?

Hello, I'm also very interested in this topic. Given a dataflow, which has incremental refresh set up (keeping last 12 months of data, with incremental refresh of 2 months), meaning every exeution refresh only current month and previous, I would like to have a way to refresh only one partition 4 month ago. For Datasets this is easy- Datasets are stored in underneath Analysis services. This analysis service is accessible via SSMS(SqlServerManagementStudio) using workspace XMLA endpoint.- From SSMS, refresh to single partition can be executed, so you are in full control of which partition you want to refresh. In my example, I could manually refresh my partition of 4 months ago. For Dataflows:- This is fully diferent story. Dataflows are stored in ADLS, not in Analysis Services, so obviously they cannot be reached from SSMS via analysis services connection. So same approach used for datasets do not apply to dataflows.- Question is: Is there any way to refresh a dataflow concrete partition? (I know how to do full refresh, and how to run incremental refresh for last n partitions. But questio is how to process only one partition, which is not in the range of the incremental refresh last last n partitions). Many thanks

v-janeyg-msft - Yes - the Incremental Refresh is up an running, but you have not understood the question. I want some of the older partitions. In my situation, the refresh is only updating records within the last 14 calendar day. I would like to update the partitions for 2021 to include additional data. If my incremental load was into a Power BI Dataset, I can use XLMA endpoint to refresh the older partitions. However, I need to update the partitions in Power BI Dataflow. These do not show up in the XLMA Endpoint. In theory, I should be able to overwrite the old partitions with my update.

The only option is using the refresh button which refreshes all the partitions sequentially for the initial load and then incrementally after that. There is currently no way to have control over your partitions when using dataflows. Thats why I am not using dataflows for many of my workloads so I use standard datasets instead and can easily manage the partitions in tabular editor and other tools.However with Fabric now being the new hot thing, this must be on the development backlog.

Hi, Anonymous PowerBI dataflow supports incremental refresh, It doesn't matter if it's not SSAS. As long as these two conditions are met, incremental refresh of dataflow can be performed: Using incremental refresh in dataflows created in Power BI requires that the dataflow reside in a workspace in Premium capacity. Incremental refresh in Power Apps requires Power Apps Plan 2. In either Power BI or Power Apps, using incremental refresh requires that source data ingested into the dataflow have a DateTime field on which incremental refresh can filter. More details in doc: Using incremental refresh with dataflows - Power Query | Microsoft Docs Have you tried it? Any errors? Did I answer your question? Please mark my reply as solution. Thank you very much.If not, please feel free to ask me.Best Regards,Community Support Team _ Janey

Dataflow Incremental Refresh Update Specific Partitions

19 Replies

v-janeyg-msft
Community Support
4 years ago
Hi, Anonymous

PowerBI dataflow supports incremental refresh, It doesn't matter if it's not SSAS.

As long as these two conditions are met, incremental refresh of dataflow can be performed:

Using incremental refresh in dataflows created in Power BI requires that the dataflow reside in a workspace in Premium capacity. Incremental refresh in Power Apps requires Power Apps Plan 2.

In either Power BI or Power Apps, using incremental refresh requires that source data ingested into the dataflow have a DateTime field on which incremental refresh can filter.

More details in doc:

Using incremental refresh with dataflows - Power Query | Microsoft Docs

Have you tried it? Any errors?

Did I answer your question? Please mark my reply as solution. Thank you very much.
If not, please feel free to ask me.

Best Regards,
Community Support Team _ Janey
- Anonymous
  Not applicable
  4 years ago
  v-janeyg-msft - Yes - the Incremental Refresh is up an running, but you have not understood the question. I want some of the older partitions. In my situation, the refresh is only updating records within the last 14 calendar day. I would like to update the partitions for 2021 to include additional data. If my incremental load was into a Power BI Dataset, I can use XLMA endpoint to refresh the older partitions. However, I need to update the partitions in Power BI Dataflow. These do not show up in the XLMA Endpoint.
  
  In theory, I should be able to overwrite the old partitions with my update.
  - v-janeyg-msft
    Community Support
    4 years ago
    Hi, Anonymous
    
    You can check it:
    
    Can't you see the partition when you turn it on?
    
    Did I answer your question? Please mark my reply as solution. Thank you very much.
    If not, please feel free to ask me.
    
    Best Regards,
    Community Support Team _ Janey
fragnn
New Member
3 years ago
The possibility to refresh a single partition in incremental dataflows is indeed a necessity for many.
I haven't found a way to do it yet.
The product team should definitely add the feature.
I just added my vote to the corresponding idea: Microsoft Idea (powerbi.com)

Forum Discussion

Dataflow Incremental Refresh Update Specific Partitions

19 Replies

Related content

Incremental Refresh on Dataflow sourced from SharePoint

DataFlow Incremental Refresh

Create partitions along with the incremental partitions

Incremental Refresh Dataflow Gen2

Incremental load Dataflow