Saved files are not visible in lakehouse web interface

[morz3d]

Hi, 

I want to make a dailiy backup of my PBI reports with notebook script and i came across unexpected problem where when i try to save file in lakehose it is simply not visible in folder even after some time (5 mins). 
Here is a simple example to ilustrate. 

So when i run this notebook to save simple file, and then to read it and list directory content i can see that file is saved in Files folder, nowever web interface is showing that this folder doesnt have any content.

import os

# Define the content and the filename
text_content = "This is the content of the text file."
directory = "Files"
filename = os.path.join(directory, "filename.txt")

# Example usage
directory = "Files"
delete_folder(directory)

# Create the directory if it does not exist
if not os.path.exists(directory):
    os.makedirs(directory)

# Write the content to the file
with open(filename, "w") as file:
    file.write(text_content)
    
# Read the content of the file
try:
    with open(filename, "r") as file:
        content = file.read()
    print("File content:")
    print(content)
except FileNotFoundError:
    print(f"The file {filename} does not exist.")
except IOError as e:
    print(f"An IOError occurred: {e}")

# List files and directories in the specified directory
try:
    files_and_dirs = os.listdir(directory)
    print("Files and directories in '", directory, "':")
    for item in files_and_dirs:
        print(item)
except FileNotFoundError:
    print(f"The directory {directory} does not exist.")
except PermissionError:
    print(f"Permission denied to access {directory}.")        

[morz3d]

Thanks @v-jingzhan-msft 
I always tried with "Copy relative path for Spark" but was surprise as there is no error and files are not to be find using web interface but listed if you try to list folder.

File API pathe seams to solve the problem

[v-jingzhan-msft]

I find a documentation which should be helpful. It introduces these paths. And the ABFS path returns the absolute path of the file, which should always work. 

Load data into your lakehouse with a notebook - Microsoft Fabric | Microsoft Learn

[v-jingzhan-msft · Accepted solution]

Hi @morz3d 

Try replacing the current directory "Files" with "/lakehouse/default/Files". You can get this path via "Copy File API path" option. After the execution, Refresh the folder or browser to view the file. 

Based on my test, this should work. 

If you select "Copy relative path for Spark", you will get "Files". I guess this applies to Spark but doesn't apply when you use the regular os module in Python. 

Best Regards,
Jing
If this post helps, please Accept it as Solution to help other members find it. Appreciate your Kudos!