Connecting SQL Operators Back-to Back
Scenario: I want to build complex SQL transformations on the data in my evenstream. Currently, I am using Confluent and building Flink SQL on a Kafka topic. I can create views to encapsulate complex logic which is then computed on the fly. This enables me to syntactically split up complex transformations in more managable, multi-step operations (SQL CREATE VIEW Statement in Confluent Cloud for Apache Flink | Confluent Documentation).
Problem: In Fabric Eventstreams, I can't chain SQL operators to achieve the same behaviour. This is specifically listed in limitations here: Process Events Using a SQL Operator - Microsoft Fabric | Microsoft Learn. I am forced to materilize the query result as a derived stream, incurring additional cost and cluttering the UI.
1 Comment
- arindamcMicrosoft EmployeeStatus changed:NewtoNeeds Votes
Recent ideas
Change the behavior of Fabric View (design experience) for clicking on Workspace in Navigation
Microsoft added or revamped the "design experience" down to two options only: Power BI and Fabric. Fine. Suggestion #1: Get it to REMEMBER the state I left it in when I closed the browser. I'm star...ToddChitt2 days agoSuper UserNew147Views2likes1CommentPipeline CI/CD Improvement, Get Item ID activity from workspace ID and item name
Currently when following any branch strategy that requires a separate ephemeral feature (or other) workspace running a notebook from the same workspace requires too much ground work To find the I...jnf2 days agoNew MemberNew14Views0likes0Comments