Error creating tables from S3 Shortcut (Parquet files)

[Tviney]

Hi All,

I have an AWS S3 shortcut setup with folders (partitions) of parquet files in my lakehouse. I want to create a table from these parquet files so I can query it with SQL and create views etc. When I right click the parent folder and create new table, I get the following error

The full path for my parquet files looks something like the following; 

Files/AWS/2023/11/platform=test/test_1.parquet

I don't think this should cause any issues, is there something I am missing? I assume we can take partitioned parquet files and create the tables in fabric to query through SQL?

[v-cboorla-msft]

Hi @Tviney 

Thanks for using Fabric Community and reporting this.

Apologies for the issue you have been facing.
At this time, we are reaching out to the internal team to get some help on this. We will update you once we hear back from them.
Appreciate your patience.

Thanks.

[v-cboorla-msft · Accepted solution]

Hi @Tviney 

As a work around:

Open a notebook, attach the lakehouse to the notebook and try to run the below code.

df1 = spark.read.format("parquet").load("Files/AWS_1/2023/11/platform=test/") df1.write.mode("overwrite").format("delta").save("Tables/" + "New_Table")

This should create a new table in your Lakehouse.

Hope this helps. Please let us know if you have any further questions.

[v-cboorla-msft]

Hi @Tviney 

Glad that your query got resolved. Please continue using Fabric Community for any help regarding your queries.