Forum Discussion
Azure Data Bricks Data Refresh
I have a report utilizing data import from a persisted table in Databricks. Once the dataset size increased I received the following error: Total size of serialized results of 17 tasks (4.1 GB) is b...
Hi Xiaoxin,
Thanks for looking at this issue. As an update we increased teh variable size to 35gb on both the clusters we are running, but still encounter the same 4gb error when attempting a refresh. We have a ticket in with the dev team to ascertain whether the error is being thrown by our Databricks instance (meaning we missed something in the adjustment of the variable) or whether it's occurring in the attempt to write to our premium capacity storage.
Julius
Did you manage to figure this out? I am getting the same error.