Scenario: I want to build complex SQL transformations on the data in my evenstream. Currently, I am using Confluent and building Flink SQL on a Kafka topic. I can create views to encapsulate complex logic which is then computed on the fly. This enables me to syntactically split up complex transformations in more managable, multi-step operations (SQL CREATE VIEW Statement in Confluent Cloud for Apache Flink | Confluent Documentation).
Problem: In Fabric Eventstreams, I can't chain SQL operators to achieve the same behaviour. This is specifically listed in limitations here: Process Events Using a SQL Operator - Microsoft Fabric | Microsoft Learn. I am forced to materilize the query result as a derived stream, incurring additional cost and cluttering the UI.
v-mpramanik
on:
Retrieve Power BI admin activity events beyond 28 ...
on:
PULL DATAFLOW REFRESH SCHEDULE WITH THE REST API
on:
Improve error message when dataset mixes cloud and...
on:
Deployment pipeline rule for data factory pipeline...