Forum Discussion

mustaphaben's avatar
mustaphaben
Icon for Advocate I rankAdvocate I
3 months ago
Solved

Replacing Magic with MS Fabric for AS400 ODBC extraction and CSV delivery to a Window

Hello Fabric Community, We are currently analyzing a migration scenario where the goal is to replace a Magic ETL/ESB solution with Microsoft Fabric. Current process: AS400 database ↓ Magic ETL/...
data engineering
data pipeline
environment
  • tayloramy's avatar
    tayloramy
    3 months ago

    Hi mustaphaben, 

     

    I would avoid this approach, while Fabric *can* read from an on prem database and write to an on prem file share, that is not what it is designed to do. It is designed to target the cloud. 

     

    If your end goal is to replace the entire process, I would start there. In Fabric it is trivial to ingest data into a lakehouse which you can then access from a SQL endpoint in place of your existing SQL Server. 

     

    In my experience, trying to use Fabric as an on prem to on prem ETL tool functions, but it is quiet inefficient. 

     

    To answer your other questions, can Fabric read from ODBC connections? Yes, as long as the DSN is created on the gateway machine. 
     

tayloramy's avatar
tayloramy
Icon for Super User rankSuper User
3 months ago

Hi mustaphaben, 

 

I would avoid this approach, while Fabric *can* read from an on prem database and write to an on prem file share, that is not what it is designed to do. It is designed to target the cloud. 

 

If your end goal is to replace the entire process, I would start there. In Fabric it is trivial to ingest data into a lakehouse which you can then access from a SQL endpoint in place of your existing SQL Server. 

 

In my experience, trying to use Fabric as an on prem to on prem ETL tool functions, but it is quiet inefficient. 

 

To answer your other questions, can Fabric read from ODBC connections? Yes, as long as the DSN is created on the gateway machine.