Forum Discussion
Copy Data to Lakehouse - Edit Columns
- 1 year ago
Hello ringovski
If your column header having spaces, your lakehosue won't allow to ,load the csv file into destination. You can read this blog Optimizing CSV Ingestion: Transforming Space-Delim... - Microsoft Fabric Community It might help you to resolve your problem
Thank you!!!
Did I answer your question? Mark my post as a solution!
Proud to be a Super User! - Anonymous1 year ago
Hi ringovski ,
Thank you for reaching out to the Microsoft Fabric Community and providing the details.
After reviewing your setup and the conversation, I can confirm that suparnababu8 gave the right advice. The issue happens because Lakehouse doesn’t support column names with spaces, which is why your pipeline fails.
The best way to fix this without rebuilding the whole pipeline is to add a Dataflow Gen2 activity before the Copy Data activity. This lets you pull the data from SQL, rename columns to remove spaces (e.g., Customer Name to Customer_Name), and send the clean data to your Lakehouse. Once the columns are cleaned up in Dataflow Gen2, the Copy Data activity should work without errors.
You can find detailed steps on setting up Dataflow Gen2 here: Create your first Dataflow Gen2 in Microsoft Fabric.
I hope my suggestions give you good idea, if you need any further assistance, feel free to reach out.
If this post helps, then please give us Kudos and consider Accept it as a solution to help the other members find it more quickly.
Thank you.
Hi ringovski
You can copy your files in this way, On-premises-->Dataflows-->Lakehouse (By using pipelines). Bcz if you have spaces in your column headers it will not sucess. Just give a try in this way.
Thank you!!!
Did I answer your question? Mark my post as a solution!
Proud to be a Super User!
This is a pipeline, you can see it in the bottom of the image.
- suparnababu81 year ago
Super User
Hi ringovski
I saw that. I'm telling you add Dataflows and copy activity in the pipeline then you can execute your pipeline. Hope it will work.
Thank you!!!
Did I answer your question? Mark my post as a solution!
Proud to be a Super User!