Forum Discussion
Post ProdigyHow migrating a SQL dwh into Fabric
Hi,
a my customer has a dwh hosted in an Azure SQL.
It is composed of:
- a set of fact tables and dimensions tables,
- a set of ADF pipelines,
- a set of stored procedure and
- a set of notebooks in a Azure Databricks instance.
Now, how is it possible to migrate a such entire dwh into Fabric?
Does it exist a dedicated tool?
Does it occur to remake from scratch the tables, the ADF pipelines, the stored procedures, the Databrick notebooks?
Does it enough to export from Azure the objects to import them in Fabric?
Doet it exist a best practice about the dwh migration to Fabric?
Many thanks
Hi pmscorca
There are some functional differences between the data warehouse in Azure SQL and the data warehouse in Fabric. You'll need to assess whether all of the features you are currently using are available at Fabric before you migrate. There is currently no dedicated tool to migrate an overall data warehouse solution. You might need to break the migration into parts. Here are some suggestions:
- Tables: You can export the schema and data from your Azure SQL database and import them into Fabric. This process typically involves exporting data to a format like Parquet and then importing it into Fabric.
- ADF Pipelines: You might need to recreate your Azure Data Factory (ADF) pipelines in Fabric’s Data Factory. While there isn’t a direct migration tool for ADF pipelines, you can manually recreate them using the same logic and activities.
- Stored Procedures: Stored procedures can be migrated by exporting the T-SQL code and then recreating them in Fabric. Some adjustments might be necessary to ensure compatibility.
- Databricks Notebooks: Notebooks can be exported from Azure Databricks and imported into Fabric. You may need to adjust the code to align with Fabric’s environment and capabilities.
You might want to find more information from the following documentations:
Migrate to Data Factory - Microsoft Fabric | Microsoft Learn
Comparison between Fabric and Azure Synapse Spark. - Microsoft Fabric | Microsoft Learn
As of now, the migration might be time consuming and not so easy. You might need to recreate or develop some things to make it work well.
Best Regards,
Jing
If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!
4 Replies
- tharunkumarRTK
Super User
how is it possible to migrate a such entire dwh into Fabric?
Yes you can
Does it exist a dedicated tool?
At this moment there isn't any migration tool as such.
Does it occur to remake from scratch the tables, the ADF pipelines, the stored procedures, the Databrick notebooks?
Yes, with fabric you can build ADF pipekines, Stored procedures and notebooks.
Does it enough to export from Azure the objects to import them in Fabric?
It does not work in this way
Doet it exist a best practice about the dwh migration to Fabric?
Need a Power BI Consultation? Hire me on Upwork
Connect on LinkedIn
Did I answer your question? Mark my post as a solution! If I helped you, click on the Thumbs Up to give Kudos.
Proud to be a Super User!
pmscorcaHi, thanks for your reply, but I've said that the dwh is hosted on an Azure SQL and not a Synapse dedicated pool.
Moreover, I've asked how migrating a dwh to Fabric, as soon as possible.
So, I need to recreate from scratch the pipelines in Fabric, the tables in Fabric, the notebooks from the Azure Databricks service in Fabric, the triggers in Fabric, the stored procedures in Fabric and so on, isn't it?
A such work isn't a migration work but a new development work.
Thanks
Hi pmscorca
There are some functional differences between the data warehouse in Azure SQL and the data warehouse in Fabric. You'll need to assess whether all of the features you are currently using are available at Fabric before you migrate. There is currently no dedicated tool to migrate an overall data warehouse solution. You might need to break the migration into parts. Here are some suggestions:
- Tables: You can export the schema and data from your Azure SQL database and import them into Fabric. This process typically involves exporting data to a format like Parquet and then importing it into Fabric.
- ADF Pipelines: You might need to recreate your Azure Data Factory (ADF) pipelines in Fabric’s Data Factory. While there isn’t a direct migration tool for ADF pipelines, you can manually recreate them using the same logic and activities.
- Stored Procedures: Stored procedures can be migrated by exporting the T-SQL code and then recreating them in Fabric. Some adjustments might be necessary to ensure compatibility.
- Databricks Notebooks: Notebooks can be exported from Azure Databricks and imported into Fabric. You may need to adjust the code to align with Fabric’s environment and capabilities.
You might want to find more information from the following documentations:
Migrate to Data Factory - Microsoft Fabric | Microsoft Learn
Comparison between Fabric and Azure Synapse Spark. - Microsoft Fabric | Microsoft Learn
As of now, the migration might be time consuming and not so easy. You might need to recreate or develop some things to make it work well.
Best Regards,
Jing
If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!- pmscorca
Hi, thanks for your reply.
I underline that the notebooks are hosted in the Azure Databricks service and not in a Synapse Spark pool.
