Forum Discussion
Resolver IIPipeline - Copy Data - Amazon Redshift - No gateway option
Hi Nono,
Thank you for your response. I guess my question is why not offer/use a gateway for the connection. I know it's not required per your earlier reponse. However, it DOES work with a gateway with the DFG2s. Perhaps there's some technical reason that it wants to use a direct connection instead of a gateway.
However it's unexpected behavior that we would need to utilize a different authentication method than we have been using with PowerBI (semantic model and DFG2 refreshes) this entire time.
Hi coverturfLSH
Unlike some other data sources, such as Azure SQL Server, AWS Redshift does not require a gateway for data transfer. This is primarily because Redshift is designed to work directly with AWS services, particularly Amazon S3, which is often used for data loading.
Direct Connection: Redshift can connect directly to data sources like S3, DynamoDB, or EMR without needing a gateway.
Data Loading: The typical method for loading data into Redshift is through the COPY command, which pulls data from S3 or other supported sources directly into your Redshift tables.
Configuration: Ensure that your IAM roles and permissions are correctly set up to allow Redshift to access the data sources.
Amazon Redshift connector overview - Microsoft Fabric | Microsoft Learn
Configure Amazon Redshift in a copy activity - Microsoft Fabric | Microsoft Learn
Regards,
Nono Chen
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Resolver IIHi Nono,
I may not fully understand the technical side of your response. I'm currently using a gateway that my IT team set up to connect to Redshift. They manage the connection via a service account and granted me access to the gateway. I've been using the gateway to connect to Redshift to refresh my semantic models and dataflows.
When I try to create a copy activity in the pipeline it asks for a username and password which I'm not sure the IT team would be willing to share with me. Any other thoughts on how I could create a connection to Redshift?