Forum Discussion
parseJson in event-stream - no preview and error on publishing
Correct - the downstream transformations should be a minimum and only what is really needed.
The rest of the transformations is better done in the Eventhouse after ingestion.😊
I meant to transform the data before the Eventstream. Sorry for the confusion...
if you can't do that, then you have to go through the Eventhouse and transform the data there. You can use the bag_unpack to unfold the entire json with no hassle.
Sorry for the delay, other things came up.
I am consuming from an IoT-Hub directly into the Eventstream so there really is no "before the Eventstream". Or is there?
I understand that I could query the Eventhouse using bag_unpack. It is a KQL database after all. However, I also would like to do downstream transformations after the unpack using Eventstream. This would not work easily, right?
Correct - the downstream transformations should be a minimum and only what is really needed.
The rest of the transformations is better done in the Eventhouse after ingestion.😊
Hi,
Thanks for the both the question and answer 🙂
I am facing a similar issue in which I need to parse a JSON column and extract specific properties, however my destination is a Fabric Activator not an Eventhouse. As far as I know, data activator doesn't provide any data transformation capabilities, so how would this be solved in this scenario ?
As MaxTee mentioned before, a parse_string is available as a part of "Manage fields" transformation, but after publishing it returns this error:Failed to create data source: data-activator.Long running operation failed with status 'Failed'. Additional Info:'Stream Analytics job has validation errors: Query compilation error: Function 'parse_json' is unknown..'
This is my setup:
