Forum Discussion

mjohannesson's avatar
mjohannesson
Advocate I
6 years ago
Solved

Conversion from number to string failed due to undersized character buffer

Starting yesterday afternoon, several of our datasets have failed to refresh with the below error. What is the reason for this error? Our datasets imports data from Databricks Spark Delta tables usin...
Need Help
Anonymous's avatar
Anonymous
Not applicable
6 years ago

We are currently running Databricks 6.3, which should be fine, and it fails with the same error message. We opened a ticket with Microsoft.

  • Anonymous's avatar
    Anonymous
    Not applicable
    6 years ago

    Hi Anonymous 

     

    we tried 6.3 but the issue didn't solve. So we further downgraded to 5.5LTS

     

    Thanks!

  • Anonymous's avatar
    Anonymous
    Not applicable
    6 years ago

    We were facing same issue.

    you can set configuration “spark.thriftserver.arrowBasedRowSet.enabled false” under Advanced options -> Spark tab in any Databricks and restart cluster.

    This fixed the issue for us

  • Anonymous's avatar
    Anonymous
    Not applicable
    6 years ago

    Same here, tried 6.3 as stated by Microsoft on the portal, but only works on 5.5 LTS (also suggested by Microsoft in response to our case and some of you guys)

     

    Thanks