Forum Discussion
Unable to execute Stored Procedure in Lakehouse using Data Pipeline
- 1 year ago
Hi anon97242 ,
As per the current documentation, the Stored Procedure activity in Fabric Data Pipelines supports only Azure SQL and Azure SQL Managed Instances . This means that Lakehouse SQL endpoints are not available in the connection dropdown for this activity.
https://learn.microsoft.com/en-us/fabric/data-factory/stored-procedure-activity
While the Lakehouse provides a SQL analytics endpoint that allows for T-SQL queries, this endpoint is not yet integrated with the Stored Procedure activity in Data Pipelines. Therefore, stored procedures defined in the Lakehouse cannot be directly invoked within a pipeline using this activity.
https://learn.microsoft.com/en-us/fabric/data-warehouse/get-started-lakehouse-sql-analytics-endpoint
As a workaround, try using a Notebook activity or a Web activity within your pipeline to execute the Lakehouse stored procedures. For instance, a Notebook activity can run a script that connects to the Lakehouse SQL endpoint and executes the desired stored procedure. Alternatively, a Web activity can call a REST API that triggers the stored procedure execution.
This is a limitation in the current implementation of Fabric Data Pipelines, and we appreciate your feedback. The product team is aware of this gap, and enhancements to support Lakehouse stored procedures directly within pipelines are being considered for future updates
meanwhile you can submit your detailed feedback and ideas via Microsoft's official feedback channels, such as the Microsoft Fabric Ideas. Feedback submitted here is often reviewed by the product teams and can lead to meaningful improvement, your inputs will truely help grow our community.Thanks,
Prashanth Are
MS Fabric community support
Hi anon97242 ,
As per the current documentation, the Stored Procedure activity in Fabric Data Pipelines supports only Azure SQL and Azure SQL Managed Instances . This means that Lakehouse SQL endpoints are not available in the connection dropdown for this activity.
https://learn.microsoft.com/en-us/fabric/data-factory/stored-procedure-activity
While the Lakehouse provides a SQL analytics endpoint that allows for T-SQL queries, this endpoint is not yet integrated with the Stored Procedure activity in Data Pipelines. Therefore, stored procedures defined in the Lakehouse cannot be directly invoked within a pipeline using this activity.
https://learn.microsoft.com/en-us/fabric/data-warehouse/get-started-lakehouse-sql-analytics-endpoint
As a workaround, try using a Notebook activity or a Web activity within your pipeline to execute the Lakehouse stored procedures. For instance, a Notebook activity can run a script that connects to the Lakehouse SQL endpoint and executes the desired stored procedure. Alternatively, a Web activity can call a REST API that triggers the stored procedure execution.
This is a limitation in the current implementation of Fabric Data Pipelines, and we appreciate your feedback. The product team is aware of this gap, and enhancements to support Lakehouse stored procedures directly within pipelines are being considered for future updates
meanwhile you can submit your detailed feedback and ideas via Microsoft's official feedback channels, such as the Microsoft Fabric Ideas. Feedback submitted here is often reviewed by the product teams and can lead to meaningful improvement, your inputs will truely help grow our community.
Thanks,
Prashanth Are
MS Fabric community support
Could you share documentation on how to use the Web activity to call the REST API?