Forum Discussion
Real time data transformation options
- 1 year ago
Hi
There is no rule to use update policies or mat.views at those places. So you could use the mat.views where you need joins.
You can also use joins in the Eventstream - even though they are a bit different.
When I wrote my blogpost and the YouTube video on the RTI medallion architecture, I also used update policies for silver and mat.view for gold. But that is not given. Those are just examples, and can be used there they fit in your process.
i hope you can find a way to succeed, or else let me know. I will gladly help 😊
If this is useful, please consider accepting it as a answer.
Thank you for the reply. I will look into it practically.
I would like to know one more thing from you.
While I was working with the same sample data as metioned in the Blog Post, it indicates two Tables. Those are:
- NYCTaxi
- Vendors
but while I am loading it using the Event stream I can only see NYCTaxi. I am not sure if I am missing any step or some point for the same.
Please guide.
Surely
The vendors table is a manual table I've made for the demo of the blogpost. Only to show how to make joins. You don't need it to use the Eventstream and get data all the way to the gold layer