Forum Discussion
Adding pipeline extraction date to appended data rows
- 2 years ago
You can use Copy activity with REST as Source and add UTCNow() as the Additional Column
Thank you! The issue with dataflow is, that I am unable to connect my REST API, because I have to do two queries. First authorize myself and receive a bearer token, 2nd one to use the bearer token as authorization to do the actual query. At least I did not figure out a way to do this with dataflow.
With data pipeline I can chain the two queries properly. What I did now is saving the raw data I get through data pipelines in a Datalake and transforming it with dataflow as well as adding a additional column with the current date. So it is somewhat a workaround, but it is working.
You can use Copy activity with REST as Source and add UTCNow() as the Additional Column
- PhilippM2 years ago
Advocate I
Exactly what I was looking for! I was completely missing out on this option, thank you very much!