Error while running the Stage1 notebook for the SDSF implementation

[Vishruti_P]

I am trying to implement SDSF solution for which I've deployed the required tiles from the Sustainability Solutions in Fabric.

As suggested in the overview page of following reference link, I've imported the required tables in the IngestedRawData_LH and now I'm trying to run the stage1 notebook where I am getting following error.

CreateDataFrameError: Error writing table Country to <abfs_path>.dfs.fabric.microsoft.com/Tables/Country

Both Reference and other ESG tables along with default data are already availbe in the ProcessedESG_LH
How can I resolve this and successfully run the stage1 and stage2 notebooks to complete the process.
Any help would be appreciated.
Reference link of the official documentation that I'm following: Sustainability data solutions in fabric implementation

Thank you

[Vishruti_P]

@V-yubandi-msft  Thank you for your response. I'll check all of these points.
Curious to understand why Facility table did not get created in the ProcessesESG_LH when I ran LoadReferenceDataTables notebook?
Is there a way I can add other tables in ProcessedESG_LH, in this case Facility table.

[V-yubandi-msft]

Hi @Vishruti_P ,

Thank you for your response. It is possible that the Facility table was not created due to a configuration issue or a missing step in the LoadReferenceDataTables notebook. Please verify the notebook to ensure all steps were executed correctly. If everything appears to be in order, rerun the notebook to check if the table gets created.

To incorporate the Facility table (or any other tables) into ProcessedESG_LH, please follow these steps.

• Ensure the Facility table structure aligns with the expected schema for ProcessedESG_LH.
• Utilize a notebook  to load the Facility table data into ProcessedESG_LH. 
• Confirm that you have the necessary permissions to write to ProcessedESG_LH.

If my response solved your query, please mark it as the Accepted solution to help others find it easily!

And if my answer was helpful, I'd really appreciate a 'Kudos'.

[V-yubandi-msft · Accepted solution]

Hi @Vishruti_P ,

Thank you for contacting the Microsoft Fabric community and sharing the details about your issue. It seems there might be a permissions issue with the Data Lake path. Please double-check the following steps.

• Ensure that permissions are set correctly on the Lake Storage account. The user  executing the notebook needs to have those roles.
• Ensure that the Country table in IngestedRawData_LH is valid with respect to schema requirements mentioned in the documentation.
• Look for data entries that appear to be missing, null, or corrupted to cause a processing error.  Verify the logic within the notebook as to where an error occurs.
• Double-check the path for errors -  Ensure the correct path in compliance with the correct format of usage.
• Check on all necessary dependencies and their successful installation as a library to have them properly implemented in the Notebook.

If my answer addressed your query, kindly mark it as the Accepted Solution to assist others.

I'd also be grateful for a 'Kudos' if you found my response useful.