Forum Discussion

yedu's avatar
yedu
Frequent Visitor
1 year ago
Solved

Facing Issue Switching Databricks Connection from Dev to Prod in Deployment Pipelines

Hi Everyone, I’m working on a Power BI project where I need to switch the data source from Dev to Prod automatically when moving the report through Deployment Pipelines. For SQL Server, it only nee...
  • jaineshp's avatar
    1 year ago

    Hey yedu,

    Looking at your Databricks deployment pipeline issue, here are some practical solutions I've seen work:

    Option 1: Smart Parameter Consolidation

    • Create an "Environment" parameter (Dev/Test/Prod)
    • Build all your connection details using Power Query conditionals based on this single parameter
    • Use your second parameter slot for something like "DatabaseOverride" if needed

    Option 2: Hybrid Approach

    • Keep Server Hostname and HTTP Path as your two deployment rules
    • Hard-code Database and Schema to be consistent across environments (most teams do this anyway)
    • This covers 80% of use cases and stays within the limit

    Option 3: Configuration Table Method

    • Store all connection details in a simple config table/file
    • Use one parameter to specify environment
    • Let Power Query pull the rest automatically

    Reality Check:

    The 2-parameter limit is definitely a real limitation across all connectors, not just Databricks. SQL Server works because it only needs Server + Database, but anything more complex hits this wall.

    What's Worked for Others:

    Most people I've talked to either go with Option 1 (environment parameter) or just accept that some connection details need to be manually updated. Not ideal, but Microsoft hasn't addressed this limitation yet.

    The environment parameter approach is probably your best bet - it keeps things clean and works within the existing constraints.

     

    Fixed? ✓ Mark it • Share it • Help others!


    Best Regards,
    Jainesh Poojara | Power BI Developer