Need help - Data from live query and streamed data in same dashboard is possible in pbi

[VMariapp]

Our use case and the architecture we’re planning to use explained below. Please check and let us know if this is a good approach for our use case.

Use case:

Consumption of real time streaming data from an existing Kafka topic in Power BI. The data should refresh in real time on the report.

Architecture:

1. A small Kafka consumer app( Python/ Java )reads from Kafka.
2. That app pushes data into Power BI (using Power BI Push Dataset API)
3. Power BI visualizes it live, auto refreshing as new data comes in.

Concepts:

1. Push Dataset: Create a dataset in Power BI that accepts incoming data via API.
2. Kafka consumer: Read the messages continuously from Kafka.
3. Small App: Takes Kafka data , flattens the JSON and sends it to Power BI using REST API.
4. Auto refresh: Power BI dashboards automatically refresh when new rows are pushed.

We also read this real time streaming into Power BI will be retired in October 2027 and we’d then probably use the Real time intelligence in Fabric. We have Premium capacity now and not Fabric.

[v-kathullac]

Hi @VMariapp ,

As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided for the issue worked? or Let us know if you need any further assistance?

If our response addressed, please mark it as Accept as solution and click Yes if you found it helpful.

Regards,

Chaithanya

[v-kathullac]

Hi @VMariapp ,

As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided for the issue worked? or Let us know if you need any further assistance?

If our response addressed, please mark it as Accept as solution and click Yes if you found it helpful.

Regards,

Chaithanya

[v-kathullac]

Hi @VMariapp ,

As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided for the issue worked? or Let us know if you need any further assistance?

If our response addressed, please mark it as Accept as solution and click Yes if you found it helpful.

Regards,

Chaithanya

[v-kathullac · Accepted solution]

Hi @VMariapp ,

Thank you for reaching out to Microsoft Fabric Community Forum.

can you please find the below points :

• You can combine visuals from both streamed and live/DirectQuery datasets on a single Power BI dashboard.

• Visuals must be created in separate reports (one per dataset) and then pinned to the same dashboard manually.

• No cross-filtering or interactivity between visuals from different datasets.

• Streaming dataset visuals update in real-time.

• Live/DirectQuery visuals refresh based on dashboard tile settings (default: every 15 minutes, can be reduced to 1 minute).

• Cannot mix streaming and DirectQuery data sources in the same report or visual.

• Dashboard serves as a view-only layer, combining outputs from different sources, not a unified data model.

• For interactivity between visuals, consider combining both datasets into one model using Import or DirectQuery.

Regards,

Chaithanya.

[burakkaragoz]

Hi @VMariapp ,

We’ve done something similar with Kafka + Power BI. Your setup looks solid for now – Kafka consumer pushing to a Push Dataset works fine for real-time visuals.

Just a heads-up though: streaming datasets are being retired in 2027, so long-term you’ll need to move to Real-Time Intelligence in Fabric.

Couple notes:

• Push Datasets can’t be combined with DirectQuery in the same model, so mixing live query + stream in one dashboard is tricky.
• One workaround is to land the Kafka data into a lakehouse or warehouse table and use that in a composite model.

If you’re on Premium, you’ll likely get Fabric access soon anyway – might be worth testing RTI early.

If my response resolved your query, kindly mark it as the Accepted Solution to assist others. Additionally, I would be grateful for a 'Kudos' if you found my response helpful.
translation and formatting supported by AI

[VMariapp]

We can get the fabric within this quarter.

I’d like to know:

• Is it possible to combine visuals from both datasets (streamed + live query) in a single Power BI dashboard?
• If yes, are there any limitations I should be aware of (e.g., refresh behavior, interactivity)?