Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Join us at the 2025 Microsoft Fabric Community Conference. March 31 - April 2, Las Vegas, Nevada. Use code FABINSIDER for $400 discount. Register now

Reply
Tviney
Regular Visitor

Error creating tables from S3 Shortcut (Parquet files)

Hi All,

 

I have an AWS S3 shortcut setup with folders (partitions) of parquet files in my lakehouse. I want to create a table from these parquet files so I can query it with SQL and create views etc. When I right click the parent folder and create new table, I get the following error

Tviney_0-1701275497080.png

The full path for my parquet files looks something like the following; 

 

Files/AWS/2023/11/platform=test/test_1.parquet

 

I don't think this should cause any issues, is there something I am missing? I assume we can take partitioned parquet files and create the tables in fabric to query through SQL?

1 ACCEPTED SOLUTION

Hi @Tviney 

 

As a work around:

Open a notebook, attach the lakehouse to the notebook and try to run the below code.
 
df1 = spark.read.format("parquet").load("Files/AWS_1/2023/11/platform=test/") df1.write.mode("overwrite").format("delta").save("Tables/" + "New_Table")
 

This should create a new table in your Lakehouse.

 

Hope this helps. Please let us know if you have any further questions.

View solution in original post

3 REPLIES 3
v-cboorla-msft
Community Support
Community Support

Hi @Tviney 

 

Thanks for using Fabric Community and reporting this.

Apologies for the issue you have been facing.
At this time, we are reaching out to the internal team to get some help on this. We will update you once we hear back from them.
Appreciate your patience.


Thanks.

Hi @Tviney 

 

As a work around:

Open a notebook, attach the lakehouse to the notebook and try to run the below code.
 
df1 = spark.read.format("parquet").load("Files/AWS_1/2023/11/platform=test/") df1.write.mode("overwrite").format("delta").save("Tables/" + "New_Table")
 

This should create a new table in your Lakehouse.

 

Hope this helps. Please let us know if you have any further questions.

Hi @Tviney 

 

Glad that your query got resolved. Please continue using Fabric Community for any help regarding your queries.

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!

FebFBC_Carousel

Fabric Monthly Update - February 2025

Check out the February 2025 Fabric update to learn about new features.

Feb2025 NL Carousel

Fabric Community Update - February 2025

Find out what's new and trending in the Fabric community.