Reference .SQL file in Pipeline (w/ Git Integration)
Create the ability to reference a .SQL file within Fabric Pipeline. In the Copy Data wizard, a button should be added when configuring the connection to the data source. If "Query" is selected, then there should be a button appear next to "Preview Data" that allows the user to open the file explorer and search for a .SQL which will then be imported into the copy data activity. A much more powerful feature would be to not import the .SQL file contents but allow Pipeline to reference the .SQL file directly from a remote repository like Git. This will allow developers to version control their queries used in the Copy Data activity outside of the Pipeline. An additional helpful feature would be integration with a remote repository to allow a series of .SQL files to be referenced which would create a metadata driven pipeline via custom sql scripting.
1 Comment
- fbcideas_migusrNew MemberStatus added:Needs Votes
Recent ideas
Invoke Pipeline Task - Workspace Identity Authentication
Currently, the Fabric Data Factory Invoke Pipeline task uses the user's credentials who saved the pipeline to then authenticate to the Azure Data Factory to execute the ADF pipeline. When that user'...dzebrowitz12 minutes agoAdvocate IPlanned1.8KViews61likes5CommentsFabric Pipeline should run as workspace identity
Currently, Microsoft Fabric pipelines run under the identity of the last user who modified them, which can cause disruptions when tenant administrators make changes to security policies, such as enab...pellitteris22 minutes agoAdvocate IINew1.3KViews27likes3CommentsBring Back separating Power BI artifacts on a per web page basis
Previously, the ability to have different artifacts open on different web tabs was enabled. This was beneficial if you wanted to differentiate what environments you were in, working across three diff...zoe-dean1 hour agoNew MemberNew46Views8likes0CommentsREST API Should expose credentials used in connections
When a consultant leaves a client, it's important to clean up any connections that may have the consultants credentials embedded within. I'm able to use the Fabric CLI to get the managed connections ...PeterDaniels1 hour agoAdvocate IIINew18Views6likes0CommentsExpose full activity-level error details in Workspace Monitoring Eventhouse
Microsoft Fabric Workspace Monitoring exposes activity-level pipeline telemetry in FabricDataPipelinesActivityRunsLogs, including PipelineRunId, OperationId, ActivityIterationCount, ActivityName, Act...MarcoOnnis2 hours agoNew MemberNew2Views0likes0Comments