Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Be one of the first to start using Fabric Databases. View on-demand sessions with database experts and the Microsoft product team to learn just how easy it is to get started. Watch now

Reply
Kohrinn
Helper I
Helper I

How to deal with large datasets

Hi all,

I have a large dataset that contains the live values from sensors. The values are written to the DB often, so the amount of data is rising quite fast. In such scenario, importing the data to PBI takes minutes - and I only tried last two months, not to mention years.

I tried direct query and it worked, but it's useless in my case. What I wanted to achieve is to replicate the functionality that I have when importing data - I made a chart out of live data and combined it with the table that cointains a list of events. Clicking on the row with a certain event, my chart showed how the values were changing during the event. This is not possible to replicate in Direct Query.

Do you have any suggestions how to solve such problem? Or maybe PBI is simply not a tool to do that?

 

Thank you!

1 REPLY 1
Daniel29195
Super User
Super User

@Kohrinn 

 

i dont get what didnt work exactly ? 

 

you have the direct query table, and another table in import mode , linked together ? 

 

but filtering from the import table to the direct query table doesnt work ? 

 

 

 

Helpful resources

Announcements
Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount!

Dec Fabric Community Survey

We want your feedback!

Your insights matter. That’s why we created a quick survey to learn about your experience finding answers to technical questions.

ArunFabCon

Microsoft Fabric Community Conference 2025

Arun Ulag shares exciting details about the Microsoft Fabric Conference 2025, which will be held in Las Vegas, NV.

December 2024

A Year in Review - December 2024

Find out what content was popular in the Fabric community during 2024.