Option of implementing CDC with On-premise oracle database (sync live oracle on-premdata to Fabric)

[JUNPEI]

We are exploring ways to synchronize live data from our on-premises Oracle database to Fabric. Could anyone share their experiences or suggest the best practices for implementing this? Any insights on tools or methods that work well with Microsoft technologies would be greatly appreciated.

[Anonymous]

Hi @JUNPEI ,

Thanks for the reply from lbendlin .

Your requirement is to synchronize real-time data from the local Oracle database to the fabric, right?

Ensure that you have the latest version of Oracle Client for Microsoft Tools (OCMT) installed on the computer running the gateway or any integrated services.

Oracle databases are located locally, and using a local data gateway provides a secure data transfer path to the fabric.

The gateway acts as a bridge to provide fast and secure data transfer between the local data source and the Azure service.

For more information about setup and configuration, please see:

Manage your data source - Oracle - Power BI | Microsoft Learn

If you have any further please feel free to ask.

Best Regards,
Yang
Community Support Team

If there is any post helps, then please consider Accept it as the solution  to help the other members find it more quickly.
If I misunderstand your needs or you still have problems on it, please feel free to let us know. Thanks a lot!

[JUNPEI]

Thank you, Yang.

However, what we need is to have real-time Oracle on-premise data in the Fabric data warehouse. This will enable us to create a complex data mart that incorporates other data sources.

[lbendlin]

Microsoft have no idea what CDC is.  You are on your own there.  Best they can offer is DeltaLake with versioning.

[Maio]

I think they do know what CDC is....

[lbendlin]

yes. now they do. but it's not their preferred choice.

[JUNPEI]

Thank you. We might need to consider a third-party tool like Qlik Replicator to enable CDC.

[pallavi_r]

Hi @JUNPEI 

Can you please let me know how did you resolve this issue. I am facing similar issue. Your opinion might help me out. Thanks,

Pallavi

[JUNPEI]

Since our target database is transactional (Oracle Database). We are thinking to get the data every 30 mins which is good enough for our use. Unless micrsoft impmenete CDC feature with on-premise datbase, especially for other database (oracle, mysql), i don't there is a way to implement that without a third part tool. 

[pallavi_r]

Hi @JUNPEI , Thanks a lot for replying. Which ingestion mode you are considering. Data pipeline copy activity, dataflow or pipeline.

Thanks,

Pallavi

[JUNPEI]

You can use Data pipline to ingest (copy), cleanse/transform the data (notebook - sql or pyspark).