Using local GPU–trained ML models with Microsoft Fabric + Agent-based architecture

Hi Ravella_Vikhil ,

Thanks for reaching out to the Microsoft fabric community forum. 

Architecture looks reasonable, especially when Fabric compute or student credits are limited. Microsoft guidance also shows that Fabric is often used for data analytics and storage, while ML models or agent orchestration can run in external services.

Architecture looks reasonable, especially when Fabric compute or student credits are limited. Microsoft guidance also shows that Fabric is often used for data analytics and storage, while ML models or agent orchestration can run in external services.

https://learn.microsoft.com/en-us/azure/architecture/ai-ml/

Also, in the Microsoft AI Decision Framework, Fabric data agents are mainly designed for analytics scenarios. When workflows require complex orchestration or multi-agent behavior, Microsoft recommends using external agent frameworks that call Fabric APIs instead of doing everything inside Fabric. Because of this, a hybrid design like yours  Fabric for Lakehouse and analytics, Azure OpenAI for reasoning, and a backend service for ML inference aligns well with current Microsoft architecture patterns.

If I misunderstand your needs or you still have problems on it, please feel free to let us know. 

Best Regards, 
Community Support Team

Hello v-menakakota ,

Thank you both for the clarification and for sharing the guidance.

Your explanation confirms that my proposed hybrid architecture aligns well with Microsoft-recommended patterns, especially when Microsoft Fabric compute or student credits are limited. Using Fabric primarily for Lakehouse storage and analytics, while running ML inference and agent orchestration in an external backend service, fits my use case well.

I also appreciate the insight around the Microsoft AI Decision Framework—that Fabric data agents are mainly optimized for analytics scenarios, and that more complex multi-agent orchestration is better handled using external agent frameworks that call Fabric APIs. This directly supports my approach of implementing tool-based agents that interact with Django services, ORM logic, and locally trained ML models, alongside Azure OpenAI for reasoning.

Thank you again, v-menakakota , for the helpful direction and reference links. This guidance is very valuable for ensuring my hackathon project follows Microsoft best practices while remaining cost-effective.

Best regards,