Excel to Delta transformations in Shortcut Transformations (Preview) provides the same zero-code ingestion experience you know from CSV, Parquet, and JSON to the world’s widely used spreadsheet format.
Why Excel? The reality
Excel remains the universal language of business data. From financial reports and sales forecasts to inventory trackers and HR onboarding lists, organizations have billions of Excel files holding critical business data that needs to flow into analytics platforms. Analysts and data engineering teams receive recurring Excel files from multiple sources such as partners, operational systems, and business users and must reliably ingest, standardize, and integrate that data into scalable data platforms to drive reporting, governance, and advanced analytics.
Excel is widely used but has been historically challenging to operationalize at scale. Ingesting Excel into a lakehouse is more complex than other formats due to:
- Multi-sheet structure: A single workbook can contain dozens of related (or unrelated) data tables across tabs.
- Schema inconsistency: Sheets often vary in columns, data types, and layout.
- Business-driven formatting: Title rows, banners, summary footers, merged cells, and blank separators are common.
- Lack of native parsers. Unlike formats such as Parquet or JSON, Excel requires specialized readers.
Previously, this meant building and maintaining custom Spark notebooks with the spark-excel library, handling sheet iteration manually, stitching together fragile ingestion logic, managing schema mappings, and maintaining ETL pipelines. Shortcut Transformations change that.
What’s new: Excel to Delta with Shortcut Transformations
With Excel to Delta in Shortcut Transformations, you can ingest multi-sheet Excel workbooks into Delta tables without writing a single line of code. The same low-code experience that powers CSV, Parquet, and JSON ingestion now extends to .xlsx and .xls files.
- Automatic sheet discovery: Shortcut Transformations read the workbook metadata and discover all sheet names automatically.
- Multi-sheet processing: Process all sheets, specific sheets by name, sheets by index, or use wildcard patterns (Sales_*) to match sheets dynamically.
- Two output modes to choose:
- Combined Table with all sheets merged into a single Delta table with metadata columns for full traceability.
- Table per Sheet with each sheet becomes its own Delta table (e.g., sales/January, sales/February), with same-named sheets from different files automatically consolidated.
- Automatic schema inference and schema drift: Column names and data types are inferred from each sheet. Schema is validated across sheets, mismatches are detected, logged, and handled gracefully.
- Cross-sheet schema validation: When merging sheets into a single table, schemas are compared. If a sheet has a different structure, you control the behavior: skip the mismatched sheet (with a warning) or fail the transform.
- Continuous sync: Similar to other Shortcut Transformation formats, new and modified Excel files are detected automatically. When a file changes in your source folder, the Delta table is refreshed with no manual re-runs needed.
- Sheet name sanitization: Sheet names like "Sales Data (Q1)" are automatically sanitized to valid table names (Sales_Data_Q1).
- Managed error handling: Success, failure, and warning details are captured per-file and per-sheet with error codes and explanatory messages in the monitoring view including sheet-specific errors.
- Intelligent skip and currency code: Title banners, metadata rows, empty columns before the table and empty Rows are skipped intelligently recognizing the table data appropriately and currency code is stored as a separate column.
Figure: Ingesting excel data from SharePoint to Fabric Lakehouse.
Getting started is simple
- Select or create a new Fabric Lakehouse.
- Select New Table Shortcut or New Schema Shortcut and choose your source (e.g., Azure Data Lake, Azure Blob Storage, Amazon S3, GCP, SharePoint, OneDrive, etc.).
- Pick your file folder containing Excel files, verify transforms in the shortcut transformation wizard, and save your Shortcut.
- Track refreshes in the Manage Shortcuts hub.
- View logs in the monitoring view for complete transparency — including per-sheet processing details.
Real-world impact across roles
Finance analyst
A global finance team consolidates monthly P&L reports from 12 regional offices. Each office sends an Excel workbook with sheets named by month. With Shortcut Transformations, the analyst sets up a single shortcut with sheet_names = "January, February, March" and output mode Combined Table. All 12 files × 3 sheets = 36 data sets flow into one Delta table with filepath column and sheetname columns to trace every row back to its origin. Dashboards stay fresh automatically as new monthly files arrive.
HR operations
An HR team manages employee onboarding data across multiple Excel templates. Each template has a "New Hires" sheet and several reference tabs ("Departments", "Locations", "Instructions"). Using sheet name filtering (sheet_names = "New Hires"), only the relevant data is ingested with reference tabs and instruction sheets are automatically skipped. When schema mismatches occur (e.g., a regional office adds an extra column), skip_on_error ensures processing continues with warnings logged.
Supply chain data engineer
A manufacturing company receives daily inventory snapshots like multi-sheet Excel files from 50 warehouse locations. Each file has sheets for "Raw Materials", "Finished Goods", and "WIP". Using table-per-sheet mode, three separate Delta tables are created automatically. Same-named sheets from different files are consolidated Raw_Materials contains data from all 50 warehouses, filterable by filepath column.
Retail analyst
A retail chain receives weekly sales data from franchise partners in Excel format. Different partners use different sheet names ("Weekly Sales", "SalesData", "Sales_Report"). Using wildcard patterns (sheet_names = "*Sales*"), all variations are captured automatically without needing to maintain an explicit list.
Resources
With Excel to Delta in Shortcut Transformations, teams can move from manual ingestion to scalable, low-code data pipelines—bringing familiar Excel workflows into a modern lakehouse without added complexity.
To learn more and understand existing limitations, refer to the Shortcut transformations documentation.
Provide your feedback and suggest ideas via Fabric Ideas.
Related Blog Posts:
Microsoft Employee
