Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
nbj-ksdh
Frequent Visitor

Eventstream to Lakehouse ingestion - output events trailing/spiking/missing

We are receiving approx. 2000 events of quite large, complex json every minute from a Google PubSub source, and ingesting it to a Lakehouse delta table via an Eventstream. No transformation steps. We are experiencing some very strange behaviour when the eventstream writes to the tables - it is only writing about 1/3 of the input received to the tables - and it's not because of errors. The runtime logs are empty. I'm providing a picture of the data insights tab below, showcasing the behaviour. 

output input issues.png

 

I've tried ingesting the same source to an Eventhouse, and everything runs smoothly there (input = output). 

 

The most spooky thing is that the events just disappear without any error / information.
Why is the Lakehouse not able to consume the input events properly? 
Thanks in advance.

2 REPLIES 2
PrachiJain_2025
Advocate V
Advocate V

Hello @nbj-ksdh ,

 

Is Eventstream working properly for you? If not, what solution have you used with Fabric?

 

Thank you

Anonymous
Not applicable

Hi @nbj-ksdh ,

 

Can you click Refresh and adjust the time zone to see it again? Through my testing, it's output events are higher than input events, I think there may be some delay in transmission. Can you open the table in notebook and then use a query statement to see if the number of rows in the table matches the number of rows in the table in the data source?

vtangjiemsft_0-1725849905664.pngvtangjiemsft_1-1725849924876.pngvtangjiemsft_2-1725850356909.png

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly. 

Helpful resources

Announcements
FabCon Global Hackathon Carousel

FabCon Global Hackathon

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes!

Real Time Intelligence in a Day

Real-Time Intelligence in a Day—Free Training

Turn streaming data into instant insights with Microsoft Fabric. Learn to connect live sources, visualize in seconds, and use Copilot + AI for smarter decisions.

September Fabric Update Carousel

Fabric Monthly Update - September 2025

Check out the September 2025 Fabric update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Solution Authors
Top Kudoed Authors