Forum Discussion

MaxTee's avatar
MaxTee
Regular Visitor
1 year ago
Solved

parseJson in event-stream - no preview and error on publishing

Hi.   I am using IoT Hub as an event stream source and the schema of incoming data includes columns like: topic, message, PartitionId, etc. - this is the usual data that is coming from an IoT Hub. ...
eventstream
  • datacoffee's avatar
    datacoffee
    1 year ago

    Correct - the downstream transformations should be a minimum and only what is really needed.
    The rest of the transformations is better done in the Eventhouse after ingestion.

     

    😊

datacoffee's avatar
datacoffee
Icon for Most Valuable Professional rankMost Valuable Professional
1 year ago

Hi there

 

in order to parse a json string you need to first tranform it to a dynamic datatype using a transform task. From there you will be able to parse it using the expected approach you are trying here with another transform task.

 

let me know if it works.

😊

MaxTee's avatar
MaxTee
Regular Visitor
1 year ago

Thanks for your reply. Unfortunately, I don't get it.

 

You say "transform task". Do you mean a "ManageFields" operation? I can change types of fields there, but not into a "dynamic type". This table suggests that event stream doesn't know a dynamic type, only eventhouse does. Or do I have to do the transformation outside of the event stream?

 

If you have a more detailed description, that would be great.