Error message for Amazon S3 Bucket Connector

[Amoroso1909]

Hi Community,

I am trying to connect to an Amazon S3 Bucket ( Amazon S3 connector overview - Microsoft Fabric | Microsoft Learn ) with a data pipeline.

Unfortunately I am receiving following error message:

"An exception occurred: DataFormat.Error: Xml processing failed. Either the input is invalid or it isn't supported. (Internal error: '=' is an unexpected token. The expected token is ';'. Line 31, position 23.)"

There are right now 2 CSV files and 1 Excel file in the bucket.

Any help to explain the issue would be highly recommendend.

Thanks in advance.

Frank

[v-cboorla-msft]

Hi @Amoroso1909 

Thanks for using Microsoft Fabric Community.

Apologize for the inconvenience.

It appears the encountered error message is related to missing IAM permissions for the user in AWS. My attempt to replicate the scenario with appropriate permissions attached via policies (directly or through groups) resulted in successful connection to the S3 bucket. For your reference, please find the screenshots.

Without appropriate permissions: Got the same error.

With appropriate permissions: Able to connect successfully.

Could you please re-check your Permissions Policies under IAM in AWS and try to connect again.

I hope this information helps. Please do let us know if you have any further questions.

Thanks.

[Amoroso1909]

Hi @v-cboorla-msft ,

thanks for your fast answer. Glad that I can adress the issue now.

However, the bucket itself is managed by our IT, thus I need to give them clear instructions. Is there a documentation, which rights are exactly needed or are you able to give me more details?

Thansk and best regards

Frank

[v-cboorla-msft]

Hi @Amoroso1909 

Permissions that needs to be configured:

To copy data from Amazon S3, make sure you've been granted the following permissions for Amazon S3 object operations: s3:GetObject and s3:GetObjectVersion.

In addition, s3:ListAllMyBuckets and s3:ListBucket/s3:GetBucketLocation permissions are required for operations like testing connection and browsing from root.

For more details please refer : Configure Amazon S3 in a copy activity

                                               : Specifying Permissions in a Policy on the AWS site.

I hope this information helps. Please do let us know if you have any further questions.

Thanks.

[v-cboorla-msft]

Hi @Amoroso1909 

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others.
Otherwise, will respond back with the more details and we will try to help.

Thanks.

[v-cboorla-msft]

Hi @Amoroso1909 

We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet. In case if you have any resolution please do share that same with the community as it can be helpful to others.
If you have any question relating to the current thread, please do let us know and we will try out best to help you.
In case if you have any other question on a different issue, we request you to open a new thread.

Thanks.

[Amoroso1909]

Hi @v-cboorla-msft 

Since I was on vacation, I did not further examine the issue, but instructed our IT to change the rights. I will do the testing soon.

Thanks again!

Best 

Frank

[Amoroso1909]

Hi @v-cboorla-msft 

unfortunately the error still exists. The mentioned IAM rights should be checked in the IAM section of the S3 bucket itself, correct?

Best regards
Frank

[v-cboorla-msft]

Hi @Amoroso1909 

Yes, the error which you are encountering is related to missing IAM permissions for the user in AWS that has to be checked in the IAM section of S3 bucket.

For more details please refer : Configure Amazon S3 in a copy activity

                                               : Specifying Permissions in a Policy on the AWS site.

I hope this information helps. Please do let us know if you have any further questions.

Thanks.

[Amoroso1909]

Hi @v-cboorla-msft ,

IT adjusted IAM settings which allowed me to reach at least one further step. Unfortunately I am receiving the now the following errors (please see below). I have access to all folders and files of that bucket.

Thanks and best regards

Frank

[v-cboorla-msft]

Hi @Amoroso1909 

To gain a clearer understanding of your data movement process and provide the most relevant guidance, would it be helpful to see some screenshots of the copy activity settings within your Microsoft Fabric pipeline? Specifically, screenshots of the source, destination, and mapping configurations would be very informative.

Thanks.

[Amoroso1909]

Hi @v-cboorla-msft ,

we managed to connect to the AWS S3 Bucket, but the existing are not shown in the preview (although they exist):

These are the comments from my colleague:

• I added the AmazonS3FullAccess group to the newly created IAM user (on top of the created inline policy, including all the necessary permissions)
• A connection to the S3 bucket is working by using the folling URL "https://lnapp4042.s3.eu-central-1.amazonaws.com"
• But the preview of the bucket content did not show any files. Also the search was not working.
• Access to the aws console is permitted for this user.

Do you have an idea why the files are not showing?

Thanks and best regards

Frank

[Amoroso1909]

Hi @v-cboorla-msft 

So far I am in the process of setting it up. The structure is pretty clear:

Using a data pipeline (because no other function supports the Amazon S3 connector) to copy data from the S3 bucket and load it into a Power BI dataflow. But I am stuck with the first step of copying the data as you can see above.

Best regards

Frank