Forum Discussion
Advocate IIDataflows - linked entities chain design
Hi,
I have a question related to dataflows and linked entities and how to best design the scenario I have.
I have 3 different data sources. For each of them, I have 3 different dataflows to ingest data from these sources.
Then I have 1 transformation dataflow which is using data from the 3 ingestion dataflows and this transformation dataflow is saved in the same workspace to utilize the auto refresh feature of the linked entities and the enhanced compute engine.
Then I have final dataflow for consumption saved in the same workspace which is using data from the transformation dataflow.
How to go about refreshing this whole dataflow chain?
The refresh of the 3 ingestion dataflows is triggered by power automate flow depending on email alert. The refresh of all 3 dataflows starts at the same time - but only one of them is refreshing successfully, the other 2 fail with ErrorMessage : Cannot acquire lock for model because it is currently in use - so I assume there is a conflict.
When I set the refresh on the transformation dataflow, then just the transformation and consumption dataflows are refreshed, but not the ingestion dataflows.
Thanks
3 Replies
- collinq
Super User
Hi Vucko ,
This seems to me like a timing issue. I would schedule each of the initial 3 dataflows to run sequentially and then schedule the 4th one (the one that puts them together) and then finally the 5th dataflow. You will have to check the run times of each and make sure that you are keeping them all sequential.
VuckoIf I start refreshing any of the ingestion dataflows, the transformation and consumption dataflows get refreshed automatically as well as per the linked entities functionality.
So there's no way how to trigger refresh of the transformation dataflow that would refresh all 3 ingestion dataflows at the same time without doing it sequentially?
