Forum Discussion
MS Fabric Notebook: Error when using dataframe.to_json() with Fabric Lakehouse storage
Hi,
I switched from JSON to Parquet and had no issue with storing the data. So for the moment I circumvented the issue.
Hi ,
The internal team has updated me that there is no such issue at their side. They are able to repro your scenario successfully using 5M records. I have attached the screenshots for your reference.
So, can you please confirm is this a consistent error or a one time glitch which throwed due to Internal Server Error.
I received this error on consecutive days.
I used the orient=records option. Maybe this got soemthing to do with the error.
Maybe my JSON data contains a character that is not properly escaped by the pandas library and then leads to errors in the underlying libraries.
Unfortunately the data is sensitive, so I can't provide an example.
Hi ,
Apologies for the issue you are facing. To eliminate the data issue, you can try validating the json to see if data is in proper json format. This might help us in identifying if the issue is from data or from ADLFS package.Hi trutz ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet . In case if you have any resolution please do share that same with the community as it can be helpful to others . If you have any question relating to the current thread, please do let us know and we will try out best to help you.Hi trutz ,
We haven’t heard from you on the last response and was just checking back to see if you have a resolution yet .
In case if you have any resolution please do share that same with the community as it can be helpful to others .
If you have any question relating to the current thread, please do let us know and we will try out best to help you.