"The remote certificate is invalid" error on pipeline Fabric job to copy parquet files from AWS S3

[soren]

When I try to copy parquet files from AWS S3 bucket with "copy data" job on pipelline function, this error show up:

"The file operation is failed. A WebException with status TrustFailure was thrown. The underlying connection was closed: Could not establish trust relationship for the SSL/TLS secure channel. The remote certificate is invalid according to the validation procedure. Activity ID: ******"

The test connection results OK.

The shortcut function works well too.

But we need to copy the data from S3 with pipeline function, the shortcut don't help us.

We try with connection type "Amazon S3 Compatible" too and we get the same error.

Some one can help or are getting this error too? Thanks!

[puneetvijwani]

@soren i recently worked to load data in S3 via spark notebooks over synapse analytics i used boto3 library to load files , 

 you'll need to have it installed via command 

pip install boto3

I suggst to try that one , hopefully that will work out with access key and secret 

However my question to use AWS S3A connector via notebooks is stil pending with Microsoft ! (Sad)