Forum Discussion

ati_puri's avatar
ati_puri
Resolver III
10 months ago

Databricks notebooks migration to Fabric Notbooks

Hi Team,

 

We are trying to migrate databricks notebooks to fabric notebooks and we face issues related to Fabric SQL incompatibilities. Suppose an update statement which runs inside a select statement in databricks does not works in Fabric, so, we need to chaneg that piece fo code to make it fabric SQL compatible. We have 100s of notebooks like these and we might have to manually do these changes.

 

So, looking for any guidance on how to automate it or is there any existing tool/solution which cna identify these incompatibilities and help reduce effort during our migration.

 

Thanks

Ati

data engineering

3 Replies

  • Vinodh247's avatar
    Vinodh247
    Super User
    10 months ago

    No direct tool exists yet to auto-convert Databricks notebooks to Fabric notebooks.


    You can automate much of it by....

    1. Extracting SQL from notebooks (%%sql or spark.sql() calls).
    2. Using SQLGlot (open-source transpiler) to convert Databricks SQL -> T-SQL/Fabric SQL.
    3. Building rule-based fixes for common issues (e.g., UPDATE in SELECT -> MERGE or temp-table pattern).
    4. Batch-running the script to flag and patch incompatible SQL across all notebooks.

    No microsoft provided tool yet, but a custom Python+SQLGlot pipeline is the best practical approach to reduce manual effort.

     

  • v-veshwara-msft's avatar
    v-veshwara-msft
    Community Support
    10 months ago

    Hi ati_puri ,

    Thanks for reaching out to Microsoft Fabric Community.

    Just wanted to check if the response provided by Vinodh247 was helpful.

    As already mentioned there is currently no Microsoft-provided tool that can automatically convert Databricks notebooks to Fabric notebooks. In most cases, the SQL logic needs to be reviewed and adjusted manually after identifying incompatible syntax. You may also try the approaches shared earlier to help automate parts of the migration and reduce manual effort.

    Thank you Vinodh247  for sharing helpful approaches. 

     

    ati_puri if you would like to see this functionality added in the future, please consider submitting it in the Fabric Ideas portal so the product team can review it.

     

    Please reach out for further assistance.

    Thank you.

  • v-veshwara-msft's avatar
    v-veshwara-msft
    Community Support
    10 months ago

    Hi ati_puri ,
    We wanted to kindly follow up regarding your query. If you need any further assistance, please reach out.
    Also, if you have submitted this as an idea in the Ideas Portal, please feel free to share the link here so others in the community can upvote it. With enough support, Microsoft may consider it for future implementation.

     

    Thank you.