Forum Discussion
Solved
Lakehouse to SQL Endpoint keeps giving error
I am having an issue building delta files through a notebook and having it populate the SQL Endpoint. Below is my code to create the delta table SalesDocs_DF.write.format('delta').mode('ove...
I appreciate the help from you all. I atually endedup figuring out how to make it work.
I found the following code through some researchonto it and it ended up working. I think my columns had some spaces or something at the end.
from pyspark.sql.functions import col
def remove_bda_chars_from_columns(df: (
return df.select([col(x).alias(x.replace(" ", "_").replace("/", "").replace("%", "pct").replace("(", "").replace(")", "")) for x in df.columns])
SalesDocs_DF = SalesDocs_DF.transform(lambda df: remove_bda_chars_from_columns(df))
Hi ghernandezmf ,
Can you please help me understand?
What all types of transformation operations are performed to the dataframe?
If possible please share the screenshot of your issue?
If you can provide me more details, I will try to guide you.