Forum Discussion

Amoroso1909's avatar
Amoroso1909
Regular Visitor
2 years ago

Error message for Amazon S3 Bucket Connector

Hi Community,   I am trying to connect to an Amazon S3 Bucket ( Amazon S3 connector overview - Microsoft Fabric | Microsoft Learn ) with a data pipeline. Unfortunately I am receiving following err...
pipelines
v-cboorla-msft's avatar
v-cboorla-msft
Microsoft Employee
2 years ago

Hi Amoroso1909 

 

Yes, the error which you are encountering is related to missing IAM permissions for the user in AWS that has to be checked in the IAM section of S3 bucket.

For more details please refer : Configure Amazon S3 in a copy activity

                                               : Specifying Permissions in a Policy on the AWS site.

 

I hope this information helps. Please do let us know if you have any further questions.

 

Thanks.

Amoroso1909's avatar
Amoroso1909
Regular Visitor
2 years ago

Hi v-cboorla-msft ,

 

IT adjusted IAM settings which allowed me to reach at least one further step. Unfortunately I am receiving the now the following errors (please see below). I have access to all folders and files of that bucket.

Thanks and best regards

Frank

 

 

  • v-cboorla-msft's avatar
    v-cboorla-msft
    Microsoft Employee
    2 years ago

    Hi Amoroso1909 

     

    To gain a clearer understanding of your data movement process and provide the most relevant guidance, would it be helpful to see some screenshots of the copy activity settings within your Microsoft Fabric pipeline? Specifically, screenshots of the source, destination, and mapping configurations would be very informative.

     

    Thanks.

  • Amoroso1909's avatar
    Amoroso1909
    Regular Visitor
    2 years ago

    Hi v-cboorla-msft 

     

    So far I am in the process of setting it up. The structure is pretty clear:

    Using a data pipeline (because no other function supports the Amazon S3 connector) to copy data from the S3 bucket and load it into a Power BI dataflow. But I am stuck with the first step of copying the data as you can see above.

     

    Best regards

    Frank

  • Amoroso1909's avatar
    Amoroso1909
    Regular Visitor
    2 years ago

    Hi v-cboorla-msft ,

     

    we managed to connect to the AWS S3 Bucket, but the existing are not shown in the preview (although they exist):

    These are the comments from my colleague:

    • I added the AmazonS3FullAccess group to the newly created IAM user (on top of the created inline policy, including all the necessary permissions)
    • A connection to the S3 bucket is working by using the folling URL "https://lnapp4042.s3.eu-central-1.amazonaws.com"
    • But the preview of the bucket content did not show any files. Also the search was not working.
    • Access to the aws console is permitted for this user.

    Do you have an idea why the files are not showing?

     

    Thanks and best regards

    Frank