Forum Discussion
parseJson in event-stream - no preview and error on publishing
- 1 year ago
Correct - the downstream transformations should be a minimum and only what is really needed.
The rest of the transformations is better done in the Eventhouse after ingestion.😊
Sorry for the delay, other things came up.
I am consuming from an IoT-Hub directly into the Eventstream so there really is no "before the Eventstream". Or is there?
I understand that I could query the Eventhouse using bag_unpack. It is a KQL database after all. However, I also would like to do downstream transformations after the unpack using Eventstream. This would not work easily, right?
Correct - the downstream transformations should be a minimum and only what is really needed.
The rest of the transformations is better done in the Eventhouse after ingestion.
😊
- Abdel191 year agoRegular Visitor
Hi,
Thanks for the both the question and answer 🙂
I am facing a similar issue in which I need to parse a JSON column and extract specific properties, however my destination is a Fabric Activator not an Eventhouse. As far as I know, data activator doesn't provide any data transformation capabilities, so how would this be solved in this scenario ?
As MaxTee mentioned before, a parse_string is available as a part of "Manage fields" transformation, but after publishing it returns this error:Failed to create data source: data-activator.Long running operation failed with status 'Failed'. Additional Info:'Stream Analytics job has validation errors: Query compilation error: Function 'parse_json' is unknown..'
This is my setup: