Forum Discussion

JoergBender's avatar
JoergBender
Frequent Visitor
3 years ago

Cannot read Parquet files from S3 to Fabric

Hey there,

 

I am currently exploring the opportunities of Fabric. Our main DataLake lives in AWS, therefore I want to load parquet files in one of the S3 buckets.

 

When I select a specific parquet file in the bucket, the Copy Activity in a Fabric pipeline returns the error " ParquetSharp does not understand the schema used". I am trying to access a valid parquet file. 

 

I also attached a Screenshot.

 

Is this a known bug? 

 

Best,

JB

data engineering

10 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    3 years ago

    Hi JoergBender Thanks for posting your question in Microsoft Fabric Community

    Currently, I am reproducing the issue and will get back to you with more details.

     

    Regrads

    Geetha

      • Anonymous's avatar
        Anonymous
        Not applicable
        3 years ago

        Hi, JoergBender as ajarora mentioned can you please log a support ticket along with a sample file with which we can reproduce?

        Regards

        Geetha

         

  • ajarora's avatar
    ajarora
    Icon for Microsoft Employee rankMicrosoft Employee
    3 years ago

    Any reason why you are specifying compression type as gzip ? 

    • JoergBender's avatar
      JoergBender
      Frequent Visitor
      3 years ago

      Because it is the default compression. See here.

      I also tried with other compressions and it did not work.

      • ajarora's avatar
        ajarora
        Icon for Microsoft Employee rankMicrosoft Employee
        3 years ago

        Can you please log a support ticket along with a sample file with which we can reproduce ?