Forum Discussion
How to split Azure resource tags in to separate columns.
Hi All,
After much research and trial and error I am trying to figure out a way to parse the Azure resource tags that are exported using the Azure Enterprise connector and use them against other metrics for cost analysis etc. I know you can split the column "Tags" based on a delimiter and assuming the correct tags are applied in the same order for each resource in to separate column's but in our environment the number of tags applied could vary. Below is an example of how the tags are displayed in the exported table.
{"Hostname":"TestSvr01","Location":"Sydney","Project":"12345","Workload":"TestApp1","Workorder":"1234"}
What I am trying to achieve is a script or a query which would search for a key word in the Tags column and then place that value into a separate column e.g. Search for the keyword Hostname and place the value next to it in a new column called hostnames. Because a resource/VM could have multiple "Workload" tags I need a method to parse the string instead of using straight delimiters to column process.
Any help with this would be very much appreciated and please ask me to clarify if anything is unclear.
On a side note I am very surprised that MS make reporting on resource tags so difficult.
Thanks
Danny
Hi v-ljerr-msft
Sorry for the multiple posts but I think I have had some success. The code below which includes an IF statement at the start does seem to do the trick and doesn't error out when it can not find the key word. It may not be pretty but it seems to do the job, if you could offer any further refinements that would be great but otherwise I think we might have cracked it.
Hostname = IF(SEARCH( "Hostname" ,'Table1-Full'[Tags],,BLANK() ) ,( VAR textLength = SEARCH ( ",", 'Table1-Full'[Tags], SEARCH ( "Hostname", 'Table1-Full'[Tags] ) + LEN ( "Hostname" ) + 3 ) - ( SEARCH ( "Hostname", 'Table1-Full'[Tags] ) + LEN ( "Hostname" ) + 3 ) - 1 RETURN MID ( 'Table1-Full'[Tags], SEARCH ( "Hostname", 'Table1-Full'[Tags] ) + LEN ( "Hostname" ) + 3, textLength )))Thanks
Danny
Hi v-ljerr-msft
Thank you for your help with developing this solution. I have updated the code slightly to cater for the fact that when a particular Tag I am searching for is at the end of the text string the code would fail because it can't find the last delimitated character ",". So I have changed the delimited character to be ". Now any tag of any length and position within the string can be found and separated out into its own column. e.g. Workload, Location, Hostname. Hopefully this code can be used by others who are trying to report against Azure resource tags.
Hostname = IF(SEARCH( "Hostname" ,'All-Azure-Data'[Data.Tags],,BLANK() ) ,( VAR textLength = SEARCH ( """", 'All-Azure-Data'[Data.Tags], SEARCH ( "Hostname", 'All-Azure-Data'[Data.Tags] ) + LEN ( "Hostname" ) + 3 ) - ( SEARCH ( "Hostname", 'All-Azure-Data'[Data.Tags] ) + LEN ( "Hostname" ) + 3 ) RETURN MID ( 'All-Azure-Data'[Data.Tags], SEARCH ( "Hostname", 'All-Azure-Data'[Data.Tags] ) + LEN ( "Hostname" ) + 3, textLength )))
8 Replies
v-ljerr-msftMicrosoft Employee
Hi Danny26,
If I understand you correctly, you should be able to use MID and FIND DAX function to create new calculate columns under Modeling tab to search for a key word in the Tags column and then place that value into a separate column in your scenario. The formula below is for your reference. :smileyhappy:
Hostname = MID ( Table1[Tags], FIND ( "Hostname", Table1[Tags] ) + LEN ( "Hostname" ) + 3, LEN ( "TestSvr01" ) )Regards
Hi v-ljerr-msft
Thank you very much for the reply you have certainly giving me that spark I needed. I have added to the code an IF statement so if the key word is not found in the particular row e.g. the row which contains all the Azure tag information then do not perform the operation otherwise I get text in there that I don't want.
Hostname =
IF(FIND("Hostname",'Table1'[Tags],,BLANK()),
MID ( 'Table1'[Tags], FIND("Hostname",Table1'[Data.Tags],,BLANK()) + LEN ( "Hostname" ) + 3, LEN ( "TestSvr01" ) ),"")I would like to add a further bit of logic which caters for a hostname of variable length. I was going about this by doing another FIND command from the position determined by the first FIND command and locate the end position of the delimited character in this case a comma ",". Once I had that number I was going to subtract the number of characters that make up the word "Hostname" to give me the total number of characters the hostname represents. So TestSvr01 would return 9 characters and Server01 would return 8 characters. With the correct number of characters found I was going to pass it to the MID command so it only extracts the right amount of text e.g. only the hostname and no trailing characters.
I understand that you cannot pass a variable or an operation in <start_num> section of a FIND command as per FIND(<find_text>, <within_text>[, [<start_num>][, <NotFoundValue>]]) because this command doesn’t work
FIND(",",'Table1'[Tags],FIND("Hostname",'Table1'[Tags],,BLANK()),BLANK())
so I am a little bit stumped as to how to calculate the correct number characters in a hostname and pass that to a MID command and extract only the hostname so any further assistance would be greatly appreciated. Also if you know of any easier way to achieve the same result say with the Power Query command "Text.PositionOf" that would be great as well. If we can solve this last outstanding question then my reports back to management would be complete.
Thanks again!
Danny
- v-ljerr-msft
Hi Danny26,
Try the formula below to see if it works in your scenario. :smileywink:
Hostname = VAR textLength = FIND ( ",", Table1[Tags], FIND ( "Hostname", Table1[Tags] ) + LEN ( "Hostname" ) + 3 ) - ( FIND ( "Hostname", Table1[Tags] ) + LEN ( "Hostname" ) + 3 ) - 1 RETURN MID ( Table1[Tags], FIND ( "Hostname", Table1[Tags] ) + LEN ( "Hostname" ) + 3, textLength )Regards