ClaudioV
5 months agoNew Member
Status:
New
SQL: Add OUTER UNION CORR–like operator (union by column name with automatic null padding)
In SAS PROC SQL, the OUTER UNION CORR operator allows vertically concatenating tables with different schemas by aligning columns by name and automatically creating missing columns filled with NULLs.
In Microsoft Fabric (Warehouse / SQL analytics endpoint / Spark SQL), this functionality is missing. Users must manually normalize schemas by explicitly adding NULL AS column_name in each SELECT, which becomes error‑prone and hard to maintain when unioning many heterogeneous datasets.
This feature is particularly important for:
- migrations from SAS to Fabric
- data lake / lakehouse ingestion patterns
- append‑only fact tables from heterogeneous sources
Adding an operator or syntax variant such as:
SELECT * FROM AOUTER UNION BY NAMESELECT * FROM Bwould significantly reduce friction and improve competitiveness with other analytics platforms.
No CommentsBe the first to comment
Recent ideas
Set SQL analytics endpoint access mode (User's identity) via REST API and Terraform
The SQL analytics endpoint enforces OneLake security only in User's identity access mode. The only documented way to choose the mode is the Security tab in the portal (Data access mode settings). Not...smorimoto3 hours agoNew MemberNew2Views0likes0Comments