Forum Discussion

Arundhati_Sen1's avatar
Arundhati_Sen1
Frequent Visitor
1 year ago
Solved

Error while reading XLSX file into dataframe using pandas

Hi, I have an Excel file (XLSX) in my lakehouse I'm trying to read this file into a pandas dataframe. I need to use the abfss path as the lakehouse is not the default one mapping_file_path = 'abfs...
data engineering
Notebook
  • Arundhati_Sen1's avatar
    Arundhati_Sen1
    1 year ago

    No it didn't help. I have changed my source file type to json now and after that I am not facing any Unauthorization issue 

v-saisrao-msft's avatar
v-saisrao-msft
Community Support
1 year ago

Hi Arundhati_Sen1,

Thank you for reaching out to the Microsoft Forum Community. Thank you FabianSchut, for your input on this issue.

Thank you for providing detailed information about the issue you’re facing. Based on your description and the discussion with the superuser, here’s a comprehensive solution to address the intermittent ClientAuthenticationError: Unauthorized issue when reading XLSX files from your Lakehouse: 

  • Please ensure that the authentication token has a sufficiently long expiration time and is set to refresh automatically if required. If you are using the DefaultAzureCredential or a custom authentication mechanism, confirm the token's expiry and refresh it proactively. 
  • Although you have confirmed that the XLSX file is closed when the issue arises, please ensure that no other processes are accessing or modifying the file at the same time. 
  • Please verify your configuration settings to confirm they are correctly set up for authentication. 

If this post helps, then please give us ‘Kudos’ and consider Accept it as a solution to help the other members find it more quickly. 

 

Thank you. 

Arundhati_Sen1's avatar
Arundhati_Sen1
Frequent Visitor
1 year ago

Hi v-saisrao-msft 
I am following https://www.youtube.com/watch?v=sjCDtDHej90&t=144s  which shows how to read excel file from lakehouse

Normally reading the file from lakehouse : 

pd.read_excel(mapping_file_path, header=0, sheet_name=0, dtype=str)


Regarding below points, how do I do that? Can you share any example for below please:
  • Please ensure that the authentication token has a sufficiently long expiration time and is set to refresh automatically if required. If you are using the DefaultAzureCredential or a custom authentication mechanism, confirm the token's expiry and refresh it proactively. 
  • Please verify your configuration settings to confirm they are correctly set up for authentication.