Skip to main content
cancel
Turn on suggestions
Auto-suggest helps you quickly narrow down your search results by suggesting possible matches as you type.
Showing results for 
Search instead for 
Did you mean: 

Did you hear? There's a new SQL AI Developer certification (DP-800). Start preparing now and be one of the first to get certified. Register now

conxu-ms
Microsoft Employee
‎03-20-2026 11:45 AM

Modernizing pipelines: New activities and innovations in Fabric Data Factory pipelines

If you haven’t already, check out Arun Ulag’s hero blog “FabCon and SQLCon 2026: Unifying databases and Fabric on a single, complete platform” for a complete look at all of our FabCon and SQLCon announcements across both Fabric and our database offerings. 

Introducing the Lakehouse utility suite in Fabric pipelines (Preview)

A healthier, more reliable Lakehouse shouldn’t require manual scripts or a patchwork of jobs. The Lakehouse Utility Suite in Fabric pipelines brings together new purpose‑built activities that let you operationalize critical Lakehouse tasks directly inside your pipelines.

This month, we’re introducing two new activities:

  • Lakehouse Maintenance activity (Preview)
  • Refresh SQL Endpoint activity (Preview)

Lakehouse maintenance activity (Preview)

Keep your Lakehouse running smoothly with automated upkeep.

Lakehouse_maintenance_activtyLakehouse_maintenance_activty

Figure: The Lakehouse maintenance activity in the Fabric pipeline’s canvas.

Use this activity to schedule routine maintenance tasks:

  • Vacuuming old files
  • Optimizing table layouts
  • Managing storage and performance upkeep
Lakehouse_Maintenance_activity_settingsLakehouse_Maintenance_activity_settings Figure: The activity settings for the Lakehouse maintenance activity.

Whether you trigger it nightly or fold it into a broader DataOps workflow, it’s an easy way to keep performance high and storage costs predictable — without the manual effort.

Check out our docs on the Lakehouse maintenance activity in Fabric pipelines at aka.ms/LakehouseMaintenanceDocs.

Refresh SQL endpoint activity (Preview)

Your SQL analytics layer is now easier to keep fresh and consistent.

Refresh_SQL_Endpoint_activityRefresh_SQL_Endpoint_activity

Figure: The Refresh SQL endpoint activity in Fabric pipeline’s canvas.

Use this activity to:

  • Refresh your Lakehouse SQL Endpoint on demand or on a schedule.
  • Sync SQL refreshes with ingestion or transformation pipelines.
  • Ensure BI and reporting scenarios always read the latest state.
It provides a seamless and consistent experience throughout the process, which is particularly advantageous for downstream users who require reliable SQL performance. Refresh_SQL_Endpoint_activity_settingsRefresh_SQL_Endpoint_activity_settings

Figure: The activity settings for the Refresh SQL endpoint activity.

Check out our docs on the Refresh SQL endpoint activity in Fabric pipeline at aka.ms/RSQLDocs.

These new activities are part of our broader investment in making Lakehouse operations more automated, more predictable, and easier to manage end-to-end. Whether you’re tightening up nightly DataOps processes, reducing manual maintenance, or creating more reliable downstream analytics, the Lakehouse Utility Suite gives you the building blocks to do it cleanly inside Fabric Data Factory pipelines.

Copilot in the Pipeline expression builder (Generally Available)

Writing pipeline expressions shouldn’t slow down development. With Copilot in the Pipeline expression builder (Generally Available), you can describe your logic in natural language and let Copilot write the expression for you.

Pipeline_expression_builder_experiencePipeline_expression_builder_experience Figure: The Pipeline expression builder Copilot experience.

Copilot can help with:

  • Dynamic paths
  • Conditional logic
  • String manipulation and parsing
  • Parameterization and reusable logic
This GA release brings faster, more accurate generation, and contextual suggestions into the pipeline builder—making it easier for both new and experienced users to work with expression syntax confidently.

Check out our docs on the Copilot for the Pipeline expression builder at aka.ms/CopilotPipelineExpression for more information on how to use this experience.

We’re just getting started—and we’d love your feedback as you try out these previews. Let us know in the comments of this blog what scenarios you want to optimize next and stay tuned for more Lakehouse-focused orchestration updates in our updates in the coming months.

Labels:
0