Forum Discussion

chetanhiwale's avatar
chetanhiwale
Resolver I
1 year ago
Solved

Spark streaming using Eventstream custom endpoint (Azure Event Hub)

I have created a Eventstream and using a custom endpoint as a source. Here my source is Azure Event hub. I am trying to read the data using spark streaming in Fabric notebook. Although I am able to s...
data engineering
Notebook
  • v-prasare's avatar
    v-prasare
    1 year ago

    Hi chetanhiwale,

    Thanks for reaching out MS Fabric communnity support

    custom endpoints in Eventstream are output-only, not sources. You cannot use Eventstream to feed Spark as a source. You either:

    • Connect Spark directly to Event Hub (bypass Eventstream)

    • Let Eventstream output to a Lakehouse or Delta, and Spark reads from that

     

    Thanks,

    Prashanth Are

v-prasare's avatar
v-prasare
Community Support
1 year ago

Hi chetanhiwale,

Thanks for reaching out MS Fabric communnity support

custom endpoints in Eventstream are output-only, not sources. You cannot use Eventstream to feed Spark as a source. You either:

  • Connect Spark directly to Event Hub (bypass Eventstream)

  • Let Eventstream output to a Lakehouse or Delta, and Spark reads from that

 

Thanks,

Prashanth Are