Forum Discussion

Srisakthi's avatar
Srisakthi
Icon for Super User rankSuper User
6 months ago
Solved

Amazon Kinesis Firehose as source for Event Stream

Hello Everyone,

 

Is there anyway we could use Kinesis Firehose as source to event stream of RTI? I see Kinesis Data Stream as source but i could not find Kinesis Firehose. It would b great if there is any option to use Kinesis as Source.

 

Few more architectural question 

1. Is it good idea to have both AWS kinesis and Event Stream together ?

2. Is it good to have events consumed from AWS Eventbridge directly into Fabric Event Stream?

 

Regards,

Srisakthi

  • Hello Srisakthi ,

    you have found the Eventstream source for Amazon Kinesis Data Streams and you are interested in support for Kinesis Firehose.

    I have no deep knowledge about both services but from it seems both AWS service life next to eachother, each with its own pos and cons.

    I recommend submitting a 'wish' for this support here. Share your wish here so others having the same question can upvote it.

    You also mention AWS Eventbridge.

    I think this is a good idea, having more ways to ingest data. Fabric add value on top of any data source, making it possible to share stream with anyone when authorized.

    ---

    If this answer helps you, a thumbs-up or marking it as accepted answer is appreaciated. All community members with similar questions will benefit by doing so. Your contribution is highly appreciated.

     

5 Replies

  • Hello Srisakthi ,

    you have found the Eventstream source for Amazon Kinesis Data Streams and you are interested in support for Kinesis Firehose.

    I have no deep knowledge about both services but from it seems both AWS service life next to eachother, each with its own pos and cons.

    I recommend submitting a 'wish' for this support here. Share your wish here so others having the same question can upvote it.

    You also mention AWS Eventbridge.

    I think this is a good idea, having more ways to ingest data. Fabric add value on top of any data source, making it possible to share stream with anyone when authorized.

    ---

    If this answer helps you, a thumbs-up or marking it as accepted answer is appreaciated. All community members with similar questions will benefit by doing so. Your contribution is highly appreciated.

     

  • v-echaithra's avatar
    v-echaithra
    Icon for Community Support rankCommunity Support

    Hi Srisakthi ,

     

    Just checking in were you able to post this issu in the ideas forum? If so, feel free to share the link here so others can support it as well.

    Looking forward to your update!

    Warm regards,
    Chaithra E.

  • Hello! Currently, RTI supports Kinesis Data Streams but not Kinesis Firehose directly. You could use Firehose to deliver data to an S3 bucket or Data Lake, then use that as a source for Event Stream.

    For your architecture questions:

    1. Using both Kinesis and Event Stream is possible but can add complexity; usually choose one primary streaming source.
    2. Consuming events from EventBridge into Fabric Event Stream is feasible and works well for integrating AWS events in real-time.