Forum Discussion

DanielAmbler's avatar
DanielAmbler
Icon for Helper II rankHelper II
2 years ago
Solved

Couldnt load table error - but can preview data fine

Hi,   After writing a dataframe to the Lakehouse as a table   MyTable.write.format("delta").mode("overwrite").saveAsTable("MyTable")  (N.B - also tried using save( full ABFSS path)    - The ta...
Need Help
pipelines
  • v-cboorla-msft's avatar
    v-cboorla-msft
    2 years ago

    Hi DanielAmbler 

     

    Thanks for using Microsoft Fabric Community.

    While you mentioned using "delta" format for writing, ensure the data format in the table is compatible with Lakehouse Explorer's preview functionality. When you write your DataFrame to the Lakehouse as a Delta table, there might be a mismatch between the data types in your DataFrame and the data types expected by Lakehouse Explorer for displaying the table schema.

    If a column in your DataFrame contains data of a type not natively supported by Lakehouse Explorer for previewing, it could cause issues when expanding the table columns. For example, complex data types like nested structures might not be easily displayed. Before writing to Delta format, inspect the data types of each column in your DataFrame.

    For more details please refer : Data types - Microsoft Fabric | Microsoft Learn

    For a similar issue please refer : Solved: The requested Lakehouse operation failed. A retry ... - Microsoft Fabric Community

     

    I hope this information helps.

     

    Thank you.

DanielAmbler's avatar
DanielAmbler
Icon for Helper II rankHelper II
2 years ago

Hi v-cboorla-msft - Thanks for the reply.  I had a complex explicit schema defined with quite a few columns that had to be aliased in the final dataframe.

 

It was an aliased column that had a name of "" (i.e blank) that was causing the issue.

 

It wasnt a data type in the end but your response did prompt me to have a good look at the dataframe with some fresh eyes and gave me some ideas for building some basic sanity checks for the future.

v-cboorla-msft's avatar
v-cboorla-msft
Icon for Microsoft Employee rankMicrosoft Employee
2 years ago

Hi DanielAmbler 

 

Glad that your query got resolved.
Please continue using Fabric Community for further queries.

 

Thank you.