topic Re: Defining if a parquet file exists in a Notebook in Pipelines

Defining if a parquet file exists in a Notebook

MisterSmith — Mon, 23 Sep 2024 09:48:06 GMT

All

I need to check if a parquet file exists before running some code. Is there a way of checking if a file exists in a notebook. I just need it to return a true or false.

Thanks

Neil

Re: Defining if a parquet file exists in a Notebook

Houston-ho — Mon, 23 Sep 2024 21:28:24 GMT

if you are using python, you could read this website.

https://www.freecodecamp.org/news/how-to-check-if-a-file-exists-in-python/

Re: Defining if a parquet file exists in a Notebook

MisterSmith — Tue, 24 Sep 2024 12:12:26 GMT

Thanks for this, but they didn't work as I needed to use wildcards in my pathway. However this worked

Import glob

search_pattern = '/root_folder/*/*/*/target_file.txt'

files = glob.glob(search_pattern)
if files:
print(f"File found: {files[0]}")
else:
print("File not found.")