topic How migrating a SQL dwh into Fabric in Data Warehouse

How migrating a SQL dwh into Fabric

pmscorca — Fri, 27 Sep 2024 16:49:11 GMT

Hi,

a my customer has a dwh hosted in an Azure SQL.

It is composed of:

a set of fact tables and dimensions tables,
a set of ADF pipelines,
a set of stored procedure and
a set of notebooks in a Azure Databricks instance.

Now, how is it possible to migrate a such entire dwh into Fabric?

Does it exist a dedicated tool?

Does it occur to remake from scratch the tables, the ADF pipelines, the stored procedures, the Databrick notebooks?

Does it enough to export from Azure the objects to import them in Fabric?

Doet it exist a best practice about the dwh migration to Fabric?

Many thanks

Re: How migrating a SQL dwh into Fabric

tharunkumarRTK — Sat, 28 Sep 2024 13:42:20 GMT

pmscorca

how is it possible to migrate a such entire dwh into Fabric?

Yes you can

Does it exist a dedicated tool?

At this moment there isn't any migration tool as such.

Does it occur to remake from scratch the tables, the ADF pipelines, the stored procedures, the Databrick notebooks?

Yes, with fabric you can build ADF pipekines, Stored procedures and notebooks.

Does it enough to export from Azure the objects to import them in Fabric?

It does not work in this way

Doet it exist a best practice about the dwh migration to Fabric?

https://learn.microsoft.com/en-us/fabric/data-warehouse/migration-synapse-dedicated-sql-pool-warehouse

Need a Power BI Consultation? Hire me on Upwork

Connect on LinkedIn

Did I answer your question? Mark my post as a solution!
If I helped you, click on the Thumbs Up to give Kudos. Proud to be a Super User!

Re: How migrating a SQL dwh into Fabric

pmscorca — Sun, 29 Sep 2024 06:26:04 GMT

Hi, thanks for your reply, but I've said that the dwh is hosted on an Azure SQL and not a Synapse dedicated pool.

Moreover, I've asked how migrating a dwh to Fabric, as soon as possible.

So, I need to recreate from scratch the pipelines in Fabric, the tables in Fabric, the notebooks from the Azure Databricks service in Fabric, the triggers in Fabric, the stored procedures in Fabric and so on, isn't it?

A such work isn't a migration work but a new development work.

Thanks

Re: How migrating a SQL dwh into Fabric

Anonymous — Mon, 30 Sep 2024 08:56:17 GMT

Hi pmscorca

There are some functional differences between the data warehouse in Azure SQL and the data warehouse in Fabric. You'll need to assess whether all of the features you are currently using are available at Fabric before you migrate. There is currently no dedicated tool to migrate an overall data warehouse solution. You might need to break the migration into parts. Here are some suggestions:

Tables: You can export the schema and data from your Azure SQL database and import them into Fabric. This process typically involves exporting data to a format like Parquet and then importing it into Fabric.
ADF Pipelines: You might need to recreate your Azure Data Factory (ADF) pipelines in Fabric’s Data Factory. While there isn’t a direct migration tool for ADF pipelines, you can manually recreate them using the same logic and activities.
Stored Procedures: Stored procedures can be migrated by exporting the T-SQL code and then recreating them in Fabric. Some adjustments might be necessary to ensure compatibility.
Databricks Notebooks: Notebooks can be exported from Azure Databricks and imported into Fabric. You may need to adjust the code to align with Fabric’s environment and capabilities.

You might want to find more information from the following documentations:

Migrate to Data Factory - Microsoft Fabric | Microsoft Learn

How do I migrate existing pipelines from Azure Data Factory (or) Azure Synapse workspace to Fabric Data Factory?

Comparison between Fabric and Azure Synapse Spark. - Microsoft Fabric | Microsoft Learn

GitHub - microsoft/fabric-migration: Scripts and tooling to migrate DW and Spark workloads to Fabric.

As of now, the migration might be time consuming and not so easy. You might need to recreate or develop some things to make it work well.

Best Regards,
Jing
If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!

Re: How migrating a SQL dwh into Fabric

pmscorca — Mon, 30 Sep 2024 13:07:11 GMT

Hi, thanks for your reply.

I underline that the notebooks are hosted in the Azure Databricks service and not in a Synapse Spark pool.