Forum Discussion

nbs33's avatar
nbs33
Helper II
3 years ago
Solved

Connecting to S3 bucket with Python and Personal Gateway

Hi,

I am developing an enterprise level data model and need to connect to an S3 bucket to pull the data. The ideal way to connect would be with a Python script, we have tested and works well in desktop.

 

I have read that the only way to refresh in Service is to use a Personal Gateway. Since it is a personal gateway and can't be shared with other developers, my first thought is to connect as fallows:

 

S3 Bucket -> connect to Dataflow via Personal Gateway -> give other developers access to Dataflow.

 

Are any foreseeable issues with this setup? 

 

The end goal is to embed for customer and automate the dataflow creation, one Dataflow per customer. I have my hesitations that this will work and am not sure it is scaleable.

 

Any guidance is greatly appreciated.