Forum Discussion
Fabric Shortcut to GCP MySQL DB instance
I would like to avoid importing all the data from a Google Cloud hosted MySQL DB instance into Fabric.
Is a Shortcut an option?
If no - what would be my best approach to exposing that DB content from my Fabric?
Hi DamonY there is no supported shortcut functonality from Fabric to MySQL (MySQL in any cloud vendor). And there's no database mirroring supported either. So you'd either need to connect from Fabric to the MySQL instance on GCP and load the data in using pipelines or notebooks (and you hopefully have some watermark to identify changed data to do incremenatals after a first full load) or you could export the data from MySQL to GCP storage and then shortcut to the GCP storage from Fabric. Perhaps GCP Dataflow has functionality to export data from MySQL to Parquet or Delta format
3 Replies
Hi DamonY,
AFAIK, the shortcut feature can load data from remote data source without fact data movement.
I think you should check if that data source has supported in fabric shortcut or you may need to use other type of data drivers to loading data from rest api.
Regards,Xiaoxin Sheng
- AndyDDC
Most Valuable Professional
Hi DamonY there is no supported shortcut functonality from Fabric to MySQL (MySQL in any cloud vendor). And there's no database mirroring supported either. So you'd either need to connect from Fabric to the MySQL instance on GCP and load the data in using pipelines or notebooks (and you hopefully have some watermark to identify changed data to do incremenatals after a first full load) or you could export the data from MySQL to GCP storage and then shortcut to the GCP storage from Fabric. Perhaps GCP Dataflow has functionality to export data from MySQL to Parquet or Delta format
Hi DamonY ,
Did the above suggestions help with your scenario? if that is the case, you can consider Kudo or Accept the helpful suggestions to help others who faced similar requirements.
If these also don't help, please share more detailed information and description to help us clarify your scenario to test.
How to Get Your Question Answered Quickly
Regards,
Xiaoxin Sheng
