Connecting SQL Operators Back-to Back
Scenario: I want to build complex SQL transformations on the data in my evenstream. Currently, I am using Confluent and building Flink SQL on a Kafka topic. I can create views to encapsulate complex logic which is then computed on the fly. This enables me to syntactically split up complex transformations in more managable, multi-step operations (SQL CREATE VIEW Statement in Confluent Cloud for Apache Flink | Confluent Documentation).
Problem: In Fabric Eventstreams, I can't chain SQL operators to achieve the same behaviour. This is specifically listed in limitations here: Process Events Using a SQL Operator - Microsoft Fabric | Microsoft Learn. I am forced to materilize the query result as a derived stream, incurring additional cost and cluttering the UI.
1 Comment
- arindamcMicrosoft EmployeeStatus changed:NewtoNeeds Votes
Recent ideas
- Mark120448 minutes agoNew MemberNew4Views0likes0Comments
notebookutils.runtime.context['userName'] doesn't work for Workspace Identity or Service Principal
Please make notebookutils.runtime.context return the name of the Workspace Identity or Service Principal when running a notebook under such identities. userId is populated with the object id of the ...frithjof_v2 hours agoCommunity ChampionNew11Views0likes0CommentsAzure Key Vault Support for On-Prem SQL Connections
Enable Azure Key Vault integration for on-premises SQL Server connections configured through an On-Premises Data Gateway, allowing customers to: Store SQL Server usernames and passwords in Azure Ke...RohiniUppu6 hours agoMicrosoft EmployeeNew5Views0likes0Comments