topic Re: Best solution for migrating to Fabric? in Fabric platform

Best solution for migrating to Fabric?

Anonymous — Mon, 19 Jun 2023 20:16:54 GMT

Hi There,

I'm about to develop a new small data warehousing solution using Synapse Analytics. I do not have the opportunity to develop this in Fabric yet. However, I'd like to make sure that I can easily migrate this to Fabric at a later date.

I appreciate that Microsoft have not yet announced what migration tools will be available in the future so I am wondering what will likely be the easiest migration path from Synapse to Fabric?

In the short term, is it best to develop a set of delta-based dim and fact tables using:

Spark pool-based scripts?
SQL Serverless-based solution?
Synapse Lake database?
Other?

I hope that makes sense.

Thank you

Re: Best solution for migrating to Fabric?

KevinConanMSFT — Tue, 20 Jun 2023 13:55:31 GMT

Greetings!

We are building migration tools that will make it easy for you to migrate from a Synapse Dedicated Pool to Fabric.

You can also try out Fabric today to see if it will meet the needs of your new data warehouse.

Re: Best solution for migrating to Fabric?

Anonymous — Tue, 20 Jun 2023 14:17:21 GMT

hI KevinConanMSFT

Great, thanks for the info. However, we don't use dedicated pools.

Are you able to advise which of the other options - e.g. serverless database, lakehouse database or Pyspark scripts would be the easiest solution to develop a data warehousing solution in now and migrate to Synapse in the future?

Thank you!

Mikael

Re: Best solution for migrating to Fabric?

KevinConanMSFT — Tue, 20 Jun 2023 14:34:21 GMT

Greetings!

If you are looking at that route, I would suggest looking at a combination of Spark Pools and Serverless. That will get you into the mindset of using a Lakehouse which will be easier to port to Fabric. Plus, when you do move it to Fabric, you'll get the SQL Endpoint for the Lakehouse which is an easy way to get T-SQL capability over data managed by Spark!

Re: Best solution for migrating to Fabric?

Anonymous — Tue, 20 Jun 2023 15:19:20 GMT

Hi KevinConanMSFT

Great, thanks for that. Would you be able to offer a little more perspective on how you would use Spark Pools and Serverless for designing a data warehousing solution? I.e. what you would use Spark and Serverless components for specifically?

Thank you

Re: Best solution for migrating to Fabric?

KevinConanMSFT — Tue, 20 Jun 2023 15:20:39 GMT

The really quick answer is that I would use Spark for the data ingestion and transformation and then Serverless Pools for the serving layer (pointing Power BI to the Serverless Pool).

Re: Best solution for migrating to Fabric?

Anonymous — Tue, 20 Jun 2023 15:54:27 GMT

Hi KevinConanMSFT ,

Great thank you. Just so I understand you, do you mean:

- Use Spark (probably Pyspark) to ingest data AND create dim and fact tables

- Use a Serverless db to point to these dim and fact tables to serve these to Power BI (but not do any data transformation to create dim/fact tables within the serverless db itself?)

Hope that makese sense,

Thank you