User Profile
SaumyaMathai
New Member
Joined 5 months ago
User Widgets
Contributions
- 1.4KViews0likes0Comments
Extracting data from External API
Hi everyone, I am new to this community and also fairly new to Microsoft Fabric. I work for a Multi Academy Trust, and we recently implemented Fabric using a Medallion Architecture with our core data coming from a SQL database. Now we need to bring in external API data (for example: Teaching systems, HR systems, Finance systems) into Fabric so that we can build live dashboards. I am trying to understand the best architectural approach to ingest and manage these APIs within our existing medallion setup. From my current understanding, there seem to be a few possible options: Option 1: Create separate pipelines and a separate medallion architecture for each API, and then integrate the results into the main architecture (SQL-based). Concern: This could lead to multiple pipelines and higher maintenance. Option 2: Ingest the API data directly into the same Bronze layer where our SQL data lands, and process it through the same Bronze → Silver → Gold pipeline. Benefit: Only one pipeline to maintain. Option 3: Create an additional Platinum layer for external APIs, and then connect that layer to the Gold layer of the main architecture. Has anyone implemented something similar in Fabric? What would be the recommended pattern for ingesting multiple APIs while keeping the architecture scalable and maintainable? Any guidance or best practices would be greatly appreciated. Thanks in advance. SaumyaSolved1.5KViews0likes7Comments
Data Privacy
Microsoft Fabric Community and Privacy
To learn more about how we manage your data, please review the Microsoft Fabric Community Data Privacy guide.