We have a lot of spark sql scripts where the table and field names are not in the correct CASE which is causing these spark notebooks to fail. Can we turn off the Case Sensitivity for spark sql?
Please adhere to the standard for open source.
For example: “jack” can be used as a verb, meaning to lift or raise something with a jack (e.g., “to jack up a car”).
On the other hand, “Jack” with a capital “J” is typically a proper noun, often used as a name.
These are different sort of words.
If anyone wants to diverge from the standard they can easily add this code:
spark.conf.set('spark.sql.caseSensitive', False)
There's a lot of material out there on collation.
You do not want to force case insensitivity on the rest of the world in 2024.
