Dataflows - linked entities chain design

[Vucko]

Hi,

I have a question related to dataflows and linked entities and how to best design the scenario I have.

I have 3 different data sources. For each of them, I have 3 different dataflows to ingest data from these sources.
Then I have 1 transformation dataflow which is using data from the 3 ingestion dataflows and this transformation dataflow is saved in the same workspace to utilize the auto refresh feature of the linked entities and the enhanced compute engine.
Then I have final dataflow for consumption saved in the same workspace which is using data from the transformation dataflow.

How to go about refreshing this whole dataflow chain?
The refresh of the 3 ingestion dataflows is triggered by power automate flow depending on email alert. The refresh of all 3 dataflows starts at the same time - but only one of them is refreshing successfully, the other 2 fail with ErrorMessage : Cannot acquire lock for model because it is currently in use - so I assume there is a conflict.
When I set the refresh on the transformation dataflow, then just the transformation and consumption dataflows are refreshed, but not the ingestion dataflows.

Thanks

[collinq]

Hi @Vucko ,

This seems to me like a timing issue.  I would schedule each of the initial 3 dataflows to run sequentially and then schedule the 4th one (the one that puts them together) and then finally the 5th dataflow.  You will have to check the run times of each and make sure that you are keeping them all sequential.

[Vucko]

If I start refreshing any of the ingestion dataflows, the transformation and consumption dataflows get refreshed automatically as well as per the linked entities functionality. 

So there's no way how to trigger refresh of the transformation dataflow that would refresh all 3 ingestion dataflows at the same time without doing it sequentially?

[collinq]

Hey @Vucko ,

I do not believe that there is a way to do it from the dataflow itself to get it to work right....but....I am wondering about using Power Automate/Flow?  I personally do not have knowledge to help write that but perhaps somebody at your organization (or you) can.