Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Find everything you need to get certified on Fabric—skills challenges, live sessions, exam prep, role guidance, and more. Get started

Reply
PowerRon
Post Patron
Post Patron

Shared datasets and refreshing

Hai

 

We have multiple user groups. Each user group (around 15) has its own focus, its own data. But connected to al those different area's is always the dimension 'payment agreements'.
I suppose we could have a shared dataset for each user group, consisting of a fact table with dimensions.
When the dimension 'payment agreements' is attached to every shared dataset (let's suppose there are 15 datasets), does this mean it has to be refreshed multiple times, so 15 times? Or is there a way so we only have to refresh that dimension of 17 million rows once and then every shared dataset will be updates automatically?

 

Regards 

Ron

 

Regards
Ron

1 ACCEPTED SOLUTION

Hey Ron,

 

That is one purpose of dataflows, but another is to have independent refresh and to break mega-models up into components for efficency. There is a lot to love about dataflows, documentation link here.

 

Matt Roche provides the best info on his blog about dataflows, this is the most relevant to read up on: link here as well as here for the data refresh: link here

 

The refresh schedule of the data flow is independent of any downstream report that uses that data flow but the refresh of the report itself needs to be timed, synchronized with the data flow, so that it follows that of the data flow appropriately. Thus, when the dataset is refreshed it doesnt cause the dataflow tables to refresh over and over.

View solution in original post

11 REPLIES 11
gregpetrossian
Advocate I
Advocate I

Have you thought of making that dim a dataflow instead then incorporating that into your dataset? That way you only refresh your dataflow once instead of multiple times.

Hai @gregpetrossian I have to read about that. Thougt dataflows were more for business-use to model their own data.
But what you mean is making a dataflow of that dimension and then that dataflow will be part of the datamodels / shared datasets in Power BI?

Is there somewhere an example where I can read about it?


Regards 
Ron

Hey Ron,

 

That is one purpose of dataflows, but another is to have independent refresh and to break mega-models up into components for efficency. There is a lot to love about dataflows, documentation link here.

 

Matt Roche provides the best info on his blog about dataflows, this is the most relevant to read up on: link here as well as here for the data refresh: link here

 

The refresh schedule of the data flow is independent of any downstream report that uses that data flow but the refresh of the report itself needs to be timed, synchronized with the data flow, so that it follows that of the data flow appropriately. Thus, when the dataset is refreshed it doesnt cause the dataflow tables to refresh over and over.

Thnx @gregpetrossian for the links

Hi @PowerRon ,

 

It seems that you have got the solution. If so, can you please accept the helpful answer as solution? Others who have the same request will benefit from this thread. 😀

 

Best Regards,
Xue Ding
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Greg_Deckler
Super User
Super User

@PowerRon - Currently it will need to refresh multiple times, once per dataset. Currently.


Follow on LinkedIn
@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
The Definitive Guide to Power Query (M)

DAX is easy, CALCULATE makes DAX hard...

Hai @Greg_Deckler , your answer fascinates me.
Cause you are saying "Currently"

is there something you know that I don't know ? 🙂

@PowerRon - https://docs.microsoft.com/en-us/power-platform-release-plan/2020wave2/power-bi/planned-features

 

See Composite models over Power BI datasets and Azure Analysis Services


Follow on LinkedIn
@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
The Definitive Guide to Power Query (M)

DAX is easy, CALCULATE makes DAX hard...

Hai @Greg_Deckler 

I am fairly new to Power BI but read about Composite models. Dual mode, whereby depending on the question Direct Query or Import mode is used.
But I don't fully understand how this helps me in the fact that my main dimensions only have to be refreshed once.
Can you explain with a little example?

 

Regards

Ron

@PowerRon - In theory, and I don't speak for the product team or Microsoft. But, in theory you would be able to build a composite data model that includes a live connection to a Power BI dataset. So, in theory you could have the data for your dimension that is shared across datasets stored once as it's own dataset that you then connect to live from your other datasets. Make sense?


Follow on LinkedIn
@ me in replies or I'll lose your thread!!!
Instead of a Kudo, please vote for this idea
Become an expert!: Enterprise DNA
External Tools: MSHGQM
YouTube Channel!: Microsoft Hates Greg
Latest book!:
The Definitive Guide to Power Query (M)

DAX is easy, CALCULATE makes DAX hard...

Makes sense @Greg_Deckler 

Helpful resources

Announcements
Europe Fabric Conference

Europe’s largest Microsoft Fabric Community Conference

Join the community in Stockholm for expert Microsoft Fabric learning including a very exciting keynote from Arun Ulag, Corporate Vice President, Azure Data.

Power BI Carousel June 2024

Power BI Monthly Update - June 2024

Check out the June 2024 Power BI update to learn about new features.

PBI_Carousel_NL_June

Fabric Community Update - June 2024

Get the latest Fabric updates from Build 2024, key Skills Challenge voucher deadlines, top blogs, forum posts, and product ideas.

RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

Top Solution Authors