Can a Pipeline refresh a Dataset (Semantic Model) as one of the steps?

[iBusinessBI]

I have a Pipeline that refreshes some Dataflows.

I want it also to refresh a Dataset (Semantic Model). How do I do it?

Currently I use Power Automate to refresh Data Set after a certain Dataflow is refreshed (I don't want to schedule by time, only after a Dataflow is refreshed).

But I prefer everything to be in one place - Pipeline.

How do I achive it?

[tackytechtom]

Just wanna upadate this thread: There has been released a dedicated semantic model refresh activity in Fabric pipelines. It's still in Preview, but it looks promising 🙂

Semantic model refresh activity in Data Factory for Microsoft Fabric (Preview) - Microsoft Fabric | ...

[NandanHegde]

Hey,

yes, it is possible to trigger the Power BI data set trigger post dataflow refresh leveraging the web activity  and filter activity combination in iterations.

Below would be the flow :

1) web activity : trigger the dataflow refresh via REST API

https://learn.microsoft.com/en-us/rest/api/power-bi/dataflows/refresh-dataflow

2) web activity / notebook: to get the transaction details of the latest execution :

As of now we there is no support on only getting the latest Dataflow refresh, however you can get the latest only by using some python code or other language you prefer. 

 

Example  python code:

 

import requests url = 'https://api.powerbi.com/v1.0/myorg/groups/{groupId}/dataflows/{dataflowId}/transactions'headers = {'...

  or leverage web activity to get all transaction and filter based on created time

and iterate for the status till the dataflow refresh is completed

3) once DF is success, trigger powerbi dataset refresh

Sample blog:

https://datasharkx.wordpress.com/2022/11/07/refresh-power-bi-dataflow-dataset-from-azure-data-factor...

note: some part in blog might differ as that is w.r.t PaaS ADF

[v-gchenna-msft · Accepted solution]

Hi @iBusinessBI ,

Thanks for using Fabric Community.

As I understand you are trying to refresh Dataset (Semantic Model) from Pipeline.
We can actually do it in two ways via RestAPI (using Web Activity) or sempy library (using Notebook Activity).

Following Article will provide some insights for Dataset Refresh

1. using RestAPI - Datasets - Refresh Dataset - REST API (Power BI Power BI REST APIs) | Microsoft Learn
2. using sempy - Refreshing Individual Tables and Partitions With Semantic Link (fabric.guru)

Hope this is helpful. Please let me know incase of further queries.

[iBusinessBI]

Thanks, @v-gchenna-msft 

I see that I can do it using REST API.

The Fabric environment needs to be a more low code, non-developers friendly platform.

In Power Automate I can do this with 3 clicks: choose "Refresh a deatset" action, choose Workspace, and choose a dataset - all from  a Dropdown boxes. No need for API REST knowledge, no need for coding.

Fabric Pipeline should be just as simple.  

[v-gchenna-msft]

Hi @iBusinessBI ,

Glad to know that your query got resolved. Please continue using Fabric Community for your further queries.

Appreciate if you could share the feedback on our feedback channel. Which would be open for the user community to upvote & comment on. This allows our product teams to effectively prioritize your request against our existing feature backlog and gives insight into the potential impact of implementing the suggested feature.

Hope this helps. Please let me know if you have any further queries.

[v-gchenna-msft]

Hi @iBusinessBI ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .
In case if you have any resolution please do share that same with the community as it can be helpful to others .
Otherwise, will respond back with the more details and we will try to help .

[v-gchenna-msft]

Hi @iBusinessBI ,

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .
In case if you have any resolution please do share that same with the community as it can be helpful to others .
Otherwise, will respond back with the more details and we will try to help .