Forum Discussion
How do 'Copy Data' activities actually convert data types?
Hi IntegrateGuru,
Since fabric data pipeline also reference from azure synapse features, I think you can take a look azure synapse pipeline and the data type mapping in the copy data activity.
Copy activity - Azure Data Factory & Azure Synapse | Microsoft Learn
Map Data in Azure Synapse Analytics - Azure Synapse Analytics | Microsoft Learn
For override data types, you can add a step in pipeline to modify the previous step definitions.
Regards,
Xiaoxin Sheng
- IntegrateGuru1 year agoAdvocate I
Thanks for your reply, I had already been looking at this documentation, but can't find answers to any of the above questions.
As to the suggestion of having multiple steps in the pipeline, that could work but I'd like to try to understand how the copy data activity is doing its transformations. It is not ideal or efficient to read/write the same data multiple times. If I could, I would do all my data ingestion and transformation via notebook where my toolset is not as limited.- Anonymous1 year agoNot applicable
Hi IntegrateGuru,
#1, In fact, I also not found some related documents mention about these.
You can try to check on azure synapse document or contact to azure support to ask for some detail information if you can find this definition on fabric side. (fabric synapse features have reference with azure synapse features)
#2, current customize the field type does not include in this, you can try to submit an idea for add new features to improving current activity usages.
Regards,
Xiaoxin Sheng
- Anonymous1 year agoNot applicable
- IntegrateGuru1 year agoAdvocate I
No, the interim data types remain a completely undocumented enigma, which makes it overly complicated to perform valid type mappings. I did find some hidden properties through trial and error, but nothing that has resolved any of these questions.