Forum Discussion
Redshift Copy through Pipelines
Hi JosephParkinson ,
You're right , Redshift in Fabric data pipelines doesn’t currently support using a gateway, which means it needs to connect over the internet. That would require you to whitelist Microsoft’s public IPs, which isn’t ideal from a security perspective.
Here are a few workarounds that you can try:
- Dataflows do support Redshift with a gateway. It’s not as flexible as pipelines, but it’s a secure way to pull data without opening up Redshift to the internet.
- If you're open to using Azure services, setting up a self-hosted integration runtime in ADF gives you better control over security and network access.
If this post helps, then please consider Accepting as solution to help the other members find it more quickly, don't forget to give a "Kudos" – I’d truly appreciate it!
Regards,
B Manikanteswara Reddy
I don't think this does resolve my issue I'm afraid. I can't not use a gateway for the security reasons I outlined as it would require whitelisting publicly accessible IPs - or is there an alternative?
Hi JosephParkinson ,
You're right , Redshift in Fabric data pipelines doesn’t currently support using a gateway, which means it needs to connect over the internet. That would require you to whitelist Microsoft’s public IPs, which isn’t ideal from a security perspective.
Here are a few workarounds that you can try:
- Dataflows do support Redshift with a gateway. It’s not as flexible as pipelines, but it’s a secure way to pull data without opening up Redshift to the internet.
- If you're open to using Azure services, setting up a self-hosted integration runtime in ADF gives you better control over security and network access.
If this post helps, then please consider Accepting as solution to help the other members find it more quickly, don't forget to give a "Kudos" – I’d truly appreciate it! |
Regards,
B Manikanteswara Reddy
Hi JosephParkinson ,
We wanted to kindly follow up to check if the solution provided for the issue worked? or Let us know if you need any further assistance?
If our response addressed, please mark it as Accept as solution and click Yes if you found it helpful.
Regards,
B Manikanteswara Reddy
Hi JosephParkinson ,
As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided for the issue worked? or Let us know if you need any further assistance?
If our response addressed, please mark it as Accept as solution and click Yes if you found it helpful.
Regards,
B Manikanteswara Reddy
Hi JosephParkinson ,
May I ask if you have gotten this issue resolved?
If it is solved, please mark the helpful reply or share your solution and accept it as solution, it will be helpful for other members of the community who have similar problems as yours to solve it faster.
Please don't forget to give a "Kudos " – I’d truly appreciate it!
Regards,
B Manikanteswara Reddy