Forum Discussion
Copy to LakeHouse Table from Azure BLOB (csv)
- 3 years ago
Hi,
The copy activity in a pipeline will bring the data as they are in the original files. For example, for a parquet source, it creates automatically the data type mapping:If you need to convert the types, you need to use a dataflow. You can use a dataflow for the entire process, or you can drop your file in the "Files" area and use the dataflow to convert from the "Files" area to the "Tables" area.
The pipeline can control the execution, first copying the file, than triggering the data flow for the data types transformations.
Kind Regards,Dennes
Hi,
The copy activity in a pipeline will bring the data as they are in the original files. For example, for a parquet source, it creates automatically the data type mapping:
If you need to convert the types, you need to use a dataflow. You can use a dataflow for the entire process, or you can drop your file in the "Files" area and use the dataflow to convert from the "Files" area to the "Tables" area.
The pipeline can control the execution, first copying the file, than triggering the data flow for the data types transformations.
Kind Regards,
Dennes