Forum Discussion

aarongiust's avatar
aarongiust
Frequent Visitor
2 years ago
Solved

Dataflow retains case sensitivity but not anywhere else

I created a Lakehouse table using a dataflow and it retains the camel casing I used for the table and column names but if I try to do that myself in a notebook using a CREATE TABLE statement, it just...
data engineering
  • Anonymous's avatar
    Anonymous
    2 years ago

    Hi aarongiust , govindarajan_d 

    Spark is not case sensitive by default.

     

    There is a way to handle this issue by adding spark config , using a SparkSession object named spark:

    spark.conf.set('spark.sql.caseSensitive', True)

    By default it is False.

    Hope this is helpful. Please let me know incase of further queries.

govindarajan_d's avatar
govindarajan_d
Icon for Super User rankSuper User
2 years ago

Hi aarongiust,

 

I tried it but it creates Sentence case for me:

 

Any other specific config that you are passing?