adrian_bossert's avatar
adrian_bossert
Microsoft Employee
4 months ago
Status:
Needs Votes

Connecting SQL Operators Back-to Back

Scenario: I want to build complex SQL transformations on the data in my evenstream. Currently, I am using Confluent and building Flink SQL on a Kafka topic. I can create views to encapsulate complex logic which is then computed on the fly. This enables me to syntactically split up complex transformations in more managable, multi-step operations (SQL CREATE VIEW Statement in Confluent Cloud for Apache Flink | Confluent Documentation).

 

Problem: In Fabric Eventstreams, I can't chain SQL operators to achieve the same behaviour. This is specifically listed in limitations here: Process Events Using a SQL Operator - Microsoft Fabric | Microsoft Learn. I am forced to materilize the query result as a derived stream, incurring additional cost and cluttering the UI.  

1 Comment

Recent ideas