Read Data from Lakehouse inside a Fabric SQL Database (using T-SQL)
We are working on a migration project to Fabric and need to combine data from inside a SQL Database with data in a Lakehouse then write it to another table in the database. Due to T-SQL compatibility issue with Data Warehouse, we want to use a Fabric SQL database for the Gold layer. For example:
SELECT *
FROM SilverLakehouseDeltaTable x
JOIN GoldDatabaseSQLTable y ON y.id = x.id
This should be part of a INSERT / UPDATE or MERGE such as:
INSERT INTO AnotherGoldDatabaseSQLTable
(Columns)
SELECT *
FROM SilverLakehouseDeltaTable x
JOIN GoldDatabaseSQLTable y ON y.id = x.id
The ability to read data from OneLake in a Fabric SQL database would solve this problem.
3 Comments
- nishalitNew MemberWe are actively working on this ask.
- fbcideas_migusrNew MemberStatus added:Planned
- HugoQueiroz-MSF
Microsoft Employee
Status changed:PlannedtoPlannedHi rob_carrol1, I want to provide an update. Recently we've announced the ability query Lakehouse files (Data Virtualization in SQL Database - Microsoft Fabric | Microsoft Learn) and we are actively working on adding support for Lakehouse table, as soon as we lock-in an ETA you'll be able on aka.ms/fabricroadmap website.
Recent ideas
Set default x axis scrolling position
Enable selection of the default scroll position for the x-axis on a chart. For example, on a line chart with dates as the x-axis, when not all of the data can display in the view at once, the scroll...Lisa_Krieg24 minutes agoNew MemberNeeds Votes7.9KViews1160likes105CommentsPower BI Dynamic Subscription Capacity Consumption and Recipient Processing
Issue: The concern is that the dynamic subscription workload can consume a significant amount of capacity when generating and distributing personalized report outputs. This creates a scalability conc...vivek1234411 hours agoMicrosoft EmployeeNew4Views0likes0CommentsSchedule pipeline as Service Principal
It would be beneficial to be able to specify an anonymous sp or user account while creating a schedule to run a pipeline directly in the Fabric GUI. This is currently only possible via the rest api a...Juriaan8091125512 hours agoNew MemberNew6Views0likes0CommentsImprove Databricks Native SQL Development Experience in Power BI
As organizations increasingly adopt Databricks as their primary data platform, Power BI remains a preferred tool for semantic modeling, visualization, executive reporting, and self-service analytics....Applsfan13 hours agoNew MemberNew5Views0likes0CommentsFabric Workspace Operator Role for Pipeline Monitoring and Rerun Operations
Many organizations have dedicated production support and operations teams responsible for monitoring Microsoft Fabric pipelines and responding to failures. Currently, the available workspace roles ar...cmukul00714 hours agoRegular VisitorNew67Views4likes1Comment