topic Re: Cannot query multiple files in Lakehouse in Data Engineering

Cannot query multiple files in Lakehouse

jashfabric — Tue, 12 Mar 2024 05:38:10 GMT

Hi
I am new to Fabric and experimenting with notebooks. How can I read multiple files present in a Lakehouse using a notebook?

I tried to read the csv files using this code, but receiving an error:

df = spark.read.format("csv").option("header","true").load("Files/**")

display(df)

Error: Path not found

Appreciate your help.

Re: Cannot query multiple files in Lakehouse

Anonymous — Tue, 12 Mar 2024 05:44:09 GMT

Hi jashfabric
Thanks for using Fabric Community.
You can use the below code:
df = spark.read.format("csv").option("header","true").load("Files")
display(df)

I have created a repro for you.

Hope this helps. Please let me know if you have any other questions.

Re: Cannot query multiple files in Lakehouse

jashfabric — Tue, 12 Mar 2024 09:30:12 GMT

Thank you so much Anonymous !
That helped me. Thanks for the detail explaination.

Re: Cannot query multiple files in Lakehouse

Anonymous — Tue, 12 Mar 2024 09:34:57 GMT

Hi jashfabric
Glad that your query got resolved. Please continue using Fabric Community for any help regarding your queries.