Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get certified in Microsoft Fabric—for free! For a limited time, the Microsoft Fabric Community team will be offering free DP-600 exam vouchers. Prepare now

Reply
pbix
Helper III
Helper III

Best solution for migrating to Fabric?

Hi There, 

 

I'm about to develop a new small data warehousing solution using Synapse Analytics. I do not have the opportunity to develop this in Fabric yet. However, I'd like to make sure that I can easily migrate this to Fabric at a later date. 

 

I appreciate that Microsoft have not yet announced what migration tools will be available in the future so I am wondering what will likely be the easiest migration path from Synapse to Fabric?

 

In the short term, is it best to develop a set of delta-based dim and fact tables using:

 

  • Spark pool-based scripts?
  • SQL Serverless-based solution?
  • Synapse Lake database?
  • Other?

 

I hope that makes sense.

 

Thank you

6 REPLIES 6
KevinConanMSFT
Microsoft Employee
Microsoft Employee

The really quick answer is that I would use Spark for the data ingestion and transformation and then Serverless Pools for the serving layer (pointing Power BI to the Serverless Pool).

Hi @KevinConanMSFT ,

 

Great thank you. Just so I understand you, do you mean:

 

- Use Spark (probably Pyspark) to ingest data AND create dim and fact tables

- Use a Serverless db to point to these dim and fact tables to serve these to Power BI (but not do any data transformation to create dim/fact tables within the serverless db itself?)

 

Hope that makese sense, 

 

Thank you

KevinConanMSFT
Microsoft Employee
Microsoft Employee

Greetings!

If you are looking at that route, I would suggest looking at a combination of Spark Pools and Serverless.  That will get you into the mindset of using a Lakehouse which will be easier to port to Fabric.  Plus, when you do move it to Fabric, you'll get the SQL Endpoint for the Lakehouse which is an easy way to get T-SQL capability over data managed by Spark!

Hi @KevinConanMSFT 

 

Great, thanks for that. Would you be able to offer a little more perspective on how you would use Spark Pools and Serverless for designing a data warehousing solution? I.e. what you would use Spark and Serverless components for specifically?

 

Thank you

KevinConanMSFT
Microsoft Employee
Microsoft Employee

Greetings! 

We are building migration tools that will make it easy for you to migrate from a Synapse Dedicated Pool to Fabric.

You can also try out Fabric today to see if it will meet the needs of your new data warehouse.

hI @KevinConanMSFT 

 

Great, thanks for the info. However, we don't use dedicated pools. 

 

Are you able to advise which of the other options - e.g. serverless database, lakehouse database or Pyspark scripts would be the easiest solution to develop a data warehousing solution in now and migrate to Synapse in the future? 

 

Thank you!

 

Mikael 

Helpful resources

Announcements
Oct Fabric Update Carousel

Fabric Monthly Update - October 2024

Check out the October 2024 Fabric update to learn about new features.

September Hackathon Carousel

Microsoft Fabric & AI Learning Hackathon

Learn from experts, get hands-on experience, and win awesome prizes.

October NL Carousel

Fabric Community Update - October 2024

Find out what's new and trending in the Fabric Community.