Correct structure for a relational database on AWS (Postgres)

[maysc]

Hello everyone!

I need some help here. I'm trying to build a real-time dashboard in Power BI. After a lot of research, I found that real-time intelligence in fabric should be the best way to do that.

The problem is that my relational database is on AWS and it's postgres. I thought the right thing to do would be to build a data warehouse in fabric with a data pipeline to bring data from Postgres to fabric, but I faced a lot of problems trying to do this. Now I'm also unsure whether creating a copy database within fabric would be the best option as I would have the cost of two identical databases in two different clouds. The objective is to be able to trigger every time a new row is inserted into the AWS database table and show some calculated KPIs in real time dashboard. Can someone enlighten me on how to build this structure correctly?

Thanks!

[Anonymous · Accepted solution]

Hi @maysc ,

Thanks lbendlin for the quick reply. I have some other thoughts to add:

You can add a PostgreSQL database CDC source to eventstream and then destination select an Eventhouse. you can then create a live dashboard and open it. select New Data Source. select Add Onelake data hub and then select the KQL database that was just in Eventhouse.

Add PostgreSQL Database CDC source to an eventstream - Microsoft Fabric | Microsoft Learn

Create a Real-Time Dashboard - Microsoft Fabric | Microsoft Learn

Best Regards,

Neeko Tang

If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly. 

[lbendlin]

After a lot of research, I found that real-time intelligence in fabric should be the best way to do that.

Maybe do some more research? Streaming Datasets are still an option until 2027.

Now I'm also unsure whether creating a copy database within fabric would be the best option as I would have the cost of two identical databases in two different clouds.

I don't think you will be able to avoid that.

The objective is to be able to trigger every time a new row is inserted into the AWS database table

Is your database capable of notifying you about this?  Power Automate for example would be an option to poll your database and then push the new rows into the streaming dataset.