How to migrate the existing pipelines from ADF or Azure Synapse to Microsoft Fabric?

[RaghavendranC]

Hi,

Is there any option in Fabric for migration of existing ADF and (Legacy) Synapse pipelines (along with its resources like notebooks) into fabric lakehouse?

There seems to have been a feature request (targeting GA for this) - Microsoft Idea

But I don't see it had materialized.

Please let us know.

Thanks,

Ragha

[RaghavendranC]

Hi @Anonymous @ thanks for your link. On reviewing that I see that there are no automated tools to migrate from Azure Synapse Analytics (like data, data processing pipelines, notebooks, stored procedures etc.). Is this understanding correct?

@NandanHegde - By pipelines, I meant the Data processing pipelines in Synapse. I did not quite catch your linking that to CI/CD pipelines in Fabric. Can you elaborate on what you meant by that, please?

[NandanHegde]

Hello @RaghavendranC 
Yes, as of now there are no automated tools for the migration.

And what I mean is as of today, data pipelines in Fabric have to be manually created because the JSON are read only (and are not editable). So you cannot establish CICD or automated deployment of data pipelines in Fabric and cannot move the synapse pipelines directly into data pipelines in fabric

[Anonymous]

Hi @RaghavendranC 
Thanks for using Fabric Community.
I am not able to open the Idea link which you have provided.
You can refer to this link for migrating from Synapse to Fabric:
https://learn.microsoft.com/en-us/fabric/data-engineering/migrate-synapse-overview

Hope this helps. Please let me know if you have any further questions.

[NandanHegde · Accepted solution]

Unfortunately the Data pipelines JSON code is read only as of today hence CICD/migration is currently not possible but based on the road map w.r.t Git integrations, it would be available eventually.

Roadmap  of integration :

https://learn.microsoft.com/en-us/fabric/release-plan/data-factory

[Anonymous]

Hi @RaghavendranC 
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. Otherwise, will respond back with the more details and we will try to help.
Thanks