Concatenate using || failing in pyspark spark.sql(sql_string)

Question

Hello&nbsp;I am trying to execute the following code in Fabric notebook (Pyspark cell):sql_string = """
INSERT INTO dummy_Table (Schema_Name, Table_Name, SQL_Statement)
('schema1', 'table1', "SELECT col1, col2, col3,col4,col5,col6, col5 || ''_'' || col6 as con_col FROM schema1.table1"))

spark.sql(sql_string)&nbsp;but i am getting an error around con_col. I tried the following but non of them is working single quote, two single quote, three single quote, 1 double quote but non of them is working,any suggestions or workarounds are highly appreciated.Thanks&nbsp;

sachinnandanwar · Accepted Answer

Try either of this&nbsp;sql_string = """
INSERT INTO dummy_Table (Schema_Name, Table_Name, SQL_Statement)
VALUES ('schema1', 'table1', "SELECT col1, col2, col3, col4, col5, col6, col5 || '_' || col6 as con_col FROM schema1.table1")"""

spark.sql(sql_string)&nbsp;sql_string = """
INSERT INTO dummy_Table (Schema_Name, Table_Name, SQL_Statement)
VALUES ('schema1', 'table1', 'SELECT col1, col2, col3, col4, col5, col6, col5 || ''_'' || col6 as con_col FROM schema1.table1')"""

spark.sql(sql_string)

Forum Discussion

Related content

Concatenate lists ;

Scheduled pipelines failing

Concatenated Lookup

concatenate strings

Group and Concatenate