Forum Discussion

BhoopalReddy's avatar
BhoopalReddy
New Member
2 months ago
Solved

Power BI VNet Gateway Diagnostics Logs - Automated Reporting and Failure Analysis

Does anyone have experience with automating the extraction of Power BI Service VNet Gateway logs?

 

I'm looking for an approach to automatically collect the logs (System Counters, Mashup Logs, Query Execution Report and Resource Consumption), process them, and build a reporting dashboard that provides insights into gateway health, including refresh failures, performance bottlenecks, connectivity issues, and other key operational metrics.

 

Any guidance, best practices, or recommended architectures would be greatly appreciated.

Need Help

7 Replies

  • sannavajjala's avatar
    sannavajjala
    Icon for Resolver II rankResolver II
    2 months ago

    Yes, this is possible, although Microsoft doesn't currently provide a native continuous export mechanism for VNet Gateway diagnostic logs. The logs can be downloaded from the Manage connections and gateways page and include System Counters, Mashup Logs, Query Execution Report, and Resource Consumption data. System Counters and Query Execution Reports are provided in Parquet format, while Mashup Logs are JSONL, which makes them relatively straightforward to ingest into Fabric, Azure Data Lake, or a Power BI model for analysis. 

     

    For a scalable monitoring solution, I'd recommend automating the ingestion of downloaded logs into a centralized storage layer (such as OneLake or ADLS), then building a semantic model and Power BI dashboard around key metrics including gateway CPU/memory utilization, query duration, refresh failures, throttling events, container restarts, and connectivity issues. Several organizations have also adopted community and Microsoft-backed gateway monitoring solutions that centralize gateway telemetry and provide historical trend analysis. 

     

    If you're already using Fabric, a good architecture would be Gateway Logs → OneLake/Data Lake → Fabric Dataflow/Notebook → Semantic Model → Power BI Dashboard & Alerts. This gives you both operational monitoring and long-term trend analysis for capacity planning and troubleshooting.

  • BhoopalReddy's avatar
    BhoopalReddy
    New Member
    2 months ago

    Thank you sannavajjala , for sharing your insights.

    If you have any reference links related to the following statement, could you please share them? They would be very helpful.
    " Several organizations have also adopted community and Microsoft-backed gateway monitoring solutions that centralize gateway telemetry and provide historical trend analysis. "

     

    • tharunkumarRTK's avatar
      tharunkumarRTK
      Icon for Super User rankSuper User
      2 months ago

      BhoopalReddy 

      You can follow these instructions to download vnet gateway logs from manage gateways page 

      https://learn.microsoft.com/en-us/data-integration/vnet/data-gateway-download-diagnostics

      however, I am not aware of any automated way to extract logs. I believe at present its a manual process only.

      You can reachout to the support team and check with them, and then create an idea in ideas forum

       

      You can read my blogs here:https://www.techietips.co.in/

       

       

       

       

      Connect on LinkedIn

       

       

       








      Did I answer your question? Mark my post as a solution!
      If I helped you, click on the Thumbs Up to give Kudos.

      Proud to be a Super User!
    • sannavajjala's avatar
      sannavajjala
      Icon for Resolver II rankResolver II
      2 months ago

      Hi BhoopalReddy ,

       

      Certainly. The statement is based on a combination of Microsoft-provided monitoring capabilities and community-supported gateway monitoring solutions that organizations commonly use for centralized telemetry collection and historical trend analysis.

      Microsoft References

      Community / Open-Source Solutions

      These references support the statement that organizations are increasingly using centralized monitoring solutions to aggregate gateway telemetry, visualize performance metrics, troubleshoot issues, and analyze historical trends for capacity planning and operational monitoring.

       

      Thanks,

      Manoj Annavajjala

  • v-achippa's avatar
    v-achippa
    Icon for Community Support rankCommunity Support
    2 months ago

    Hi BhoopalReddy,

     

    Thank you for reaching out to Microsoft Fabric Community.

     

    Thank you sannavajjala and tharunkumarRTK for the prompt response.

     

    As we haven’t heard back from you, we wanted to kindly follow up to check if the solution provided by the user's for the issue worked? or let us know if you need any further assistance.

     

    Thanks and regards,

    Anjan Kumar Chippa

    • v-achippa's avatar
      v-achippa
      Icon for Community Support rankCommunity Support
      2 months ago

      Hi @BhoopalReddy,

       

      We wanted to kindly follow up to check if the solution provided by the user's for the issue worked? or let us know if you need any further assistance.

       

      Thanks and regards,

      Anjan Kumar Chippa

      • BhoopalReddy's avatar
        BhoopalReddy
        New Member
        2 months ago

        Hi v-achippa ,
        I was hoping sannavajjala could share the reference links or supporting documentation for the statement below. It would be very helpful in understanding the available Microsoft or community-backed solutions.
        "Several organizations have also adopted community and Microsoft-backed gateway monitoring solutions that centralize gateway telemetry and provide historical trend analysis."

        If sannavajjala is unable to respond or provide the requested information, could you please reach out to the appropriate Microsoft team or experts who might be able to share the relevant guidance, documentation, or recommended solution?