Forum Discussion

av_9999's avatar
av_9999
Regular Visitor
2 years ago

Event Stream unable to load the data into Lakehouse\ KQL

Hi,

 

Looking some advice and help. I have a scenario. 
IOT devices messages and events data pointed to event hub (having 3-4 different message types). 

Without using the eventprocessing able to load the data into either lakehouse\ KQL by using event stream. But partial data loaded.

When tried to use the eventprocessing with Manage Fields and Filter operations then the data is loading into both lakeshouse and KQL. Created the tables seperately and also tried to load but no luck.

I am using filter operation as " column1 equals abc".


Appreciate any quick help..

 

data engineering
lakehouse

2 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    HI av_9999,

    Can you please share some more detail information about your operations and the returned error messages? I think they should help us clarify your scenario and test to troubleshooting.
    BTW, I think your requirement should be more related to the event stream and its usages, I will help you move to the correspond sub-column to get better support.

    Regards,

    Xiaoxin Sheng

  • JohanLudvig's avatar
    JohanLudvig
    Icon for Advocate I rankAdvocate I
    2 years ago

    Not sure if I get exactly what you are asking for here?

    But if I get this right then: When dealing with multiple schemas in the same Event hub queue it might be an idea to build several event streams instead of handling everything in one single stream.