Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Did you hear? There's a new SQL AI Developer certification (DP-800). Start preparing now and be one of the first to get certified. Register now

trolson

Google Cloud Storage shortcuts and S3 Compatible shortcuts generally available

GCS shortcuts and S3 Compatible shortcuts are now generally available. Utilize shortcuts in OneLake to quickly and easily make data accessible in Fabric. No need to set up pipelines or copy jobs, just create a shortcut and your data is immediately available in Fabric.   

From your Lakehouse, select new shortcut.

Google_Cloud_Storage_shortcuts_and_S3_Compatible_shortcuts_generally_availableGoogle_Cloud_Storage_shortcuts_and_S3_Compatible_shortcuts_generally_available

Choose your shortcuts type (GCS, S3 Compatible).

Google_Cloud_Storage_shortcuts_and_S3_Compatible_shortcuts_generally_availableGoogle_Cloud_Storage_shortcuts_and_S3_Compatible_shortcuts_generally_available

Configure your connection details.

Google_Cloud_Storage_shortcuts_and_S3_Compatible_shortcuts_generally_availableGoogle_Cloud_Storage_shortcuts_and_S3_Compatible_shortcuts_generally_available

Browse to your desired location and select your shortcuts target(s).

Google_Cloud_Storage_shortcuts_and_S3_Compatible_shortcuts_generally_availableGoogle_Cloud_Storage_shortcuts_and_S3_Compatible_shortcuts_generally_available

For more information on GCS shortcuts follow our guide here.
For more information on S3 Compatible shortcuts, follow our guide here.

Caching (preview)

Don’t forget to enable shortcut caching, GCS and S3 Compatible shortcuts both support caching. This can be enabled in your workspace setting by enabling shortcut caching, you can reduce your egress costs when accessing data across clouds or service providers. As data is read through your GCS or S3 Compatible shortcut, the data will be cached in OneLake. Subsequent reads are then served from OneLake rather than the remote service.

To enable cache support, open your workspace settings.

Google_Cloud_Storage_shortcuts_and_S3_Compatible_shortcuts_generally_availableGoogle_Cloud_Storage_shortcuts_and_S3_Compatible_shortcuts_generally_available

Choose OneLake, toggle Enable Cache for Shortcuts to on.

Google_Cloud_Storage_shortcuts_and_S3_Compatible_shortcuts_generally_availableGoogle_Cloud_Storage_shortcuts_and_S3_Compatible_shortcuts_generally_available

To learn more about shortcut caching, see our documentation here.

On-Premises Gateway (preview)

GCS and S3 Compatible shortcuts also support the on-premises gateway. You can utilize the gateway to connect to your on-premises S3 compatible sources as well as GCS buckets that are protected by a virtual private cloud.  

To learn more about using the on-premises gateway with shortcuts, follow our guide here.