Forum Discussion
Helper IVNotebook: Write data from snowflake (oauth) to lakehouse
After investigation with MS and Snowflake support it ended with the workaround mentioned in this topic: Solved: Re: No CA bundle file is found in the system. Set ... - Microsoft Fabric Community
The error is special to MS Fabric, as it does not occur in a local test
Helper IVHi Anonymous , how can i check this? It is an external snowflake database, we have only a reading access to the db.
HI cw88,
I mean you can check the reuslt table data size in the lakehouse.
As you said, larget than 800 rows is a target that may triggered the issue, you can try to get less than 800 rows and check the file data size in lakehosue. (you can right-click on the delta table and choose 'view files' to show the 'files view' in the list)
In addition, you can also use notebook with mssparkutils library to achieve these:
pyspark - Microsoft Fabric Lakehouse size and table sizes - Stack Overflow
Regards,
Xiaoxin Sheng
- cw88
Hi Anonymous ,
data size is 16 KB, so it should not be the problem 😞
HI cw88,
Did any changes or update that applied to the credentials you used? How long did these operation processed? BTW, how did you configure the spark session and time out? Can you please share some more detail?
Regards,
Xiaoxin Sheng
- cw88
hello Anonymous ,
Did any changes or update that applied to the credentials you used? --> No
How long did these operation processed? --> Processing takes 2-3 seconds
BTW, how did you configure the spark session and time out? Can you please share some more detail? --> No custom settings