Forum Discussion

Selcii-16's avatar
Selcii-16
New Member
24 days ago
Solved

Safest approach for handling schema changes

What is the safest approach for handling schema changes in source tables when downstream Fabric pipelines, Lakehouse tables, and Power BI semantic models depend on them? For example, if a source sys...
  • Anmoldeep's avatar
    23 days ago

    I would say that it will be a good approach  to avoid allowing source schema changes to flow directly into the reporting layer.

    A common pattern is:

    Source → Bronze/Staging → Silver → Gold → Semantic Model

    The Bronze layer can preserve the source structure, while the Silver/Gold layers provide a controlled schema for downstream consumers.

    For potentially breaking changes such as column removal, renaming, or datatype changes, it is useful to:

    • Validate the incoming schema before processing.
    • Detect additions, removals and datatype changes.
    • Keep the transformation layer independent of unnecessary source-specific changes.
    • Test changes in a development/test workspace before production deployment.
    • Review the impact on downstream pipelines, tables and semantic models before making breaking changes.
    • Use deployment/versioning practices so that schema changes can be introduced in a controlled manner.

    Adding a new nullable column is generally less disruptive than renaming/removing an existing column because downstream dependencies may reference the original column name.

    For larger Fabric environments, I would also recommend maintaining a metadata/dependency inventory so that when a source column changes, you can identify which pipelines, tables, semantic models and reports could be affected before deploying the change.

    The key principle is to detect and assess the schema change before it reaches the Gold/reporting layer, rather than discovering the problem after a production refresh fails.