Forum Discussion

12angrymentiger's avatar
12angrymentiger
Advocate III
2 years ago
Solved

Spark SQL Query errors - Case Sensitivity issues

All of a sudden as of almost 2 weeks ago our spark sql notebooks have been failing due to case sensitivity in the table and field names.  This has always worked fine in Synapse before, so I'm not sur...
data engineering
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi 12angrymentiger 
    Apologies for the issue you have been facing. At this time, we are reaching out to the internal team to get some help on this. We will update you once we hear back from them.

    A simple workaround to fix this issue is to run the below piece of code before executing the main code.

    spark.conf.set('spark.sql.caseSensitive', False)

    Hope this helps. Please let me know if you have any further questions. Glad to help.

Leachyboy_007's avatar
Leachyboy_007
New Member
2 years ago

Hi. I am experiencing a similar issue when running an SQL query in an SQL endpoint on some tables I have in a lakehouse within Microsoft Fabric. to my knowledge SQL isnt a case sensetive languaje so not sure why im having issues on the Fabric endpoint yet my queries run fine on apps such as SSMS.

Can anyone help??