Forum Discussion

maysc's avatar
maysc
New Member
1 year ago
Solved

Correct structure for a relational database on AWS (Postgres)

Hello everyone!

 

I need some help here. I'm trying to build a real-time dashboard in Power BI. After a lot of research, I found that real-time intelligence in fabric should be the best way to do that.

The problem is that my relational database is on AWS and it's postgres. I thought the right thing to do would be to build a data warehouse in fabric with a data pipeline to bring data from Postgres to fabric, but I faced a lot of problems trying to do this. Now I'm also unsure whether creating a copy database within fabric would be the best option as I would have the cost of two identical databases in two different clouds. The objective is to be able to trigger every time a new row is inserted into the AWS database table and show some calculated KPIs in real time dashboard. Can someone enlighten me on how to build this structure correctly?

 

Thanks!

Eventstream

2 Replies

  • lbendlin's avatar
    lbendlin
    Super User
    1 year ago
    After a lot of research, I found that real-time intelligence in fabric should be the best way to do that.

    Maybe do some more research? Streaming Datasets are still an option until 2027.

     

    Now I'm also unsure whether creating a copy database within fabric would be the best option as I would have the cost of two identical databases in two different clouds.

    I don't think you will be able to avoid that.

     

    The objective is to be able to trigger every time a new row is inserted into the AWS database table

    Is your database capable of notifying you about this?  Power Automate for example would be an option to poll your database and then push the new rows into the streaming dataset.

     

     

  • Anonymous's avatar
    Anonymous
    Not applicable
    1 year ago

    Hi maysc ,

     

    Thanks lbendlin for the quick reply. I have some other thoughts to add:

    You can add a PostgreSQL database CDC source to eventstream and then destination select an Eventhouse. you can then create a live dashboard and open it. select New Data Source. select Add Onelake data hub and then select the KQL database that was just in Eventhouse.

    Add PostgreSQL Database CDC source to an eventstream - Microsoft Fabric | Microsoft Learn

    Create a Real-Time Dashboard - Microsoft Fabric | Microsoft Learn

     

    Best Regards,

    Neeko Tang

    If this post  helps, then please consider Accept it as the solution  to help the other members find it more quickly.