Forum Discussion
Multiple Data Flows from Single Data Source via Gateway
Hello all,
I'm not sure how to phrase this as a question or Google Search for it, so I am hoping that someone can see my visual below and understand my problem.
I want to build multiple data flows from a single data source. IE, take in a few tables, do some ETL, then give to my org to use as a dataset for PBI. Im just starting to venture down this path and just completed my second flow and I thought that in the "Lineage view" that it would show both data flows stemming from the same source "block".
You can see above, the "FinanceSchema_Warehouse_Dataflow" and "FringeRates_Dataflow" are both using my on-prem gateway to access my Oracle DB called WPRD. However, it shows them each in their own swimlane, rather than stemming from a single block that should represent the Source.
Have I done something to incorrectly create these flows? I want to limit my strain on the data source as it is refreshing at the same time as many other jobs and my DB admins will not be happy if I am delegating too many jobs back to the source.
I want to continue to build out more data flows for the users, and want to make sure that I am doing this correctly.
Thanks in advance for any help.
-Caz
2 Replies
- Caz_16Helper II
Thank you for the documentation but unfortunately they do not provide me with an answer to my question. I know that in the image above I have a piece of the Gateway Name redacted, but that is because they are abbreviations that could identify my org. I assure you that both of these dataflows are pulling from the same data source/gateway. Below is a screenshot of my project settings, this is the same for BOTH of the Data flows that I was referencing in the image of my original post.
All signs point to that these two data flows should be stemming from the same data source/gateway.
One thing that I did note is that I renamed my gateway during this project. You can see in the image in this post that it is called AutomationHub_DataGateway, where in my original post, it is called **_FINWarehouse.
Thank you, please let me know if you can offer any further assistance.
-Caz