topic Re: parsing set variable string in Azure Data Factory in Pipelines

parsing set variable string in Azure Data Factory

krishn — Mon, 25 Mar 2024 18:15:22 GMT

We have web activity and it always return below string with value change (value is dynamic everyday). We would need to extract key value. Please advise how to achieve this in Azure Data Factory activities.

Set Activity return value : Value= "{"aws_access_key_id":"XE6MX","aws_secret_access_key":"sgD6zEe"}"

We would like to get aws_access_key_id value XE6MX in separate variable so we can pass it to subsequent activities. And this value id dynamic and changes every day

tried with replace and search functions but couldn't work out.

Re: parsing set variable string in Azure Data Factory

Riskworks115 — Mon, 25 Mar 2024 21:17:37 GMT

You should be able to use a set Variable to capture the result value of the web activity. Use that variable to save to an Azure database with a stored procedure or to some other store. I did this by making a call to the site to get a daily bearer token that I saved to an avure database table in a key value pair. Then I would use that token when making a cal to get the data. HTH.

Re: parsing set variable string in Azure Data Factory

NandanHegde — Tue, 26 Mar 2024 10:58:30 GMT

The below solution should work to parse:

@json(<<Act output>>).aws_access_key_id

Re: parsing set variable string in Azure Data Factory

Anonymous — Wed, 27 Mar 2024 16:07:16 GMT

Hi krishn
Glad that your query got resolved. Please continue using Fabric Community for any help regarding your queries.