Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Calling all Data Engineers! Fabric Data Engineer (Exam DP-700) live sessions are back! Starting October 16th. Sign up.

Reply
Kohrinn
Helper I
Helper I

How to deal with large datasets

Hi all,

I have a large dataset that contains the live values from sensors. The values are written to the DB often, so the amount of data is rising quite fast. In such scenario, importing the data to PBI takes minutes - and I only tried last two months, not to mention years.

I tried direct query and it worked, but it's useless in my case. What I wanted to achieve is to replicate the functionality that I have when importing data - I made a chart out of live data and combined it with the table that cointains a list of events. Clicking on the row with a certain event, my chart showed how the values were changing during the event. This is not possible to replicate in Direct Query.

Do you have any suggestions how to solve such problem? Or maybe PBI is simply not a tool to do that?

 

Thank you!

1 REPLY 1
Daniel29195
Super User
Super User

@Kohrinn 

 

i dont get what didnt work exactly ? 

 

you have the direct query table, and another table in import mode , linked together ? 

 

but filtering from the import table to the direct query table doesnt work ? 

 

 

 

Helpful resources

Announcements
FabCon Global Hackathon Carousel

FabCon Global Hackathon

Join the Fabric FabCon Global Hackathon—running virtually through Nov 3. Open to all skill levels. $10,000 in prizes!

September Power BI Update Carousel

Power BI Monthly Update - September 2025

Check out the September 2025 Power BI update to learn about new features.

FabCon Atlanta 2026 carousel

FabCon Atlanta 2026

Join us at FabCon Atlanta, March 16-20, for the ultimate Fabric, Power BI, AI and SQL community-led event. Save $200 with code FABCOMM.

Top Solution Authors
Top Kudoed Authors