Forum Discussion

Sunray's avatar
Sunray
Frequent Visitor
1 year ago
Solved

Fabric Scan Set Rules in Microsoft Purview

Hello,

I'm trying to scan fabric datasources into microsoft purview. I cannot seem to pick some system scan rules for fabric data sources; MS says they have some system scan rules for fabric , but nothing shows,  the screen itself is not presented. Also, the scans won't show any lineage for fabric pipelines, no lineage tab. Not sure what I'm missing on the settings.  The registration for fabric data sources is all verified and good. Any advice?

Thanks.

  • Hi Sunray,
    After thoroughly reviewing the details you provided, I have identified few alternative workarounds that may help resolve the issue. Please follow these steps:


    It is a known limitation that Microsoft Purview supports lineage for Fabric sources in OneLake but may not extend this support to external sources like on-prem SQL, Azure SQL DB, or other non-OneLake sources. This could indeed be a limitation in the current version of Purview for Fabric, as Microsoft is still rolling out extended capabilities for lineage tracking.

    The absence of Scan Set Rules for Fabric and the inability to create custom scan rules for Fabric may indicate that Fabric is not yet fully integrated into Purview’s scanning framework.

    Create a scan rule for Azure Data Lake Storage Gen2 or Power BI, depending on the Fabric sources you are using, and see if this serves as a temporary workaround. As a temporary workaround, you might consider manually creating scan rule sets under Management Center > Scan rule sets in Purview. While Fabric-specific options may not be available, configuring general rules could provide partial functionality. I suggest monitoring their Microsoft Purview | Microsoft Learn for any improvements.

     

    Even though your Fabric registration is verified, ensure you have Scan Contributor or Purview Data Curator permissions. Certain Fabric-related features might still be rolling out based on your region. 

    New Microsoft Purview Unified Catalog deployment regions | Microsoft Learn

     

    If this post helps, then please give us ‘Kudos’ and consider Accept it as a solution to help the other members find it more quickly.

     

    Thank you.

9 Replies

  • If you see no lineage tab for Fabric pipelines, check the following:

    1. Ensure Lineage is Enabled

      • Go to Microsoft Purview → Data Map → Lineage Settings.
      • Ensure Lineage Extraction is turned ON.
    2. Check Supported Fabric Components

      • Currently, Dataflows Gen2, Pipelines, and Warehouses support lineage.
      • If your dataset is from KQL databases, Real-Time Analytics, or custom sources, lineage may not be available.
    3. Manually Trigger a Rescan

      • Go to Purview → Scans → Select Your Fabric Data Source.
      • Click Edit → Save & Run to force a scan update.
  • v-kpoloju-msft's avatar
    v-kpoloju-msft
    Icon for Community Support rankCommunity Support

    Hi Sunray,
    Thank you for reaching out to the Microsoft fabric community forum. Thanks andrewsommer, for your inputs on this issue.

     

    After thoroughly reviewing the details you provided, I have identified few alternative workarounds that may help resolve the issue. Please follow these steps:

    Microsoft has been releasing updates for Fabric support in Purview. Please verify that you are using the latest version. If the system scan rules are not visible, manually create a scan rule set under Management Center > Scan rule sets and check if Fabric-specific options are available. Ensure you possess the appropriate Purview Data Curator or Owner permissions to view and modify scan rules.

    Go to Management Center > Lineage settings in Purview and check if lineage tracking for Fabric is turned on. Not all Fabric components are supported yet for lineage tracking in Purview. Check Microsoft's documentation to confirm if pipelines are included.

     

    Set scan rule in Microsoft purview:

     

    kindly please refer to the below following links for more information:
    Create a scan rule set | Microsoft Learn

    How to scan sources | Microsoft Learn

     

    Currently, Microsoft Purview supports item-level metadata and lineage scanning for Fabric items, including Power BI artifacts. However, for non-Power BI Fabric items, certain limitations exist.

     

    • Upstream sources in lineage aren't yet supported for non-Power BI Fabric items.
    • Lineage across different workspaces for non-Power BI items isn't supported.
    • Lineage between Notebooks and Pipelines isn't supported.

    Also, please kindly go through the below link for more information:
    Metadata and Lineage from Fabric | Microsoft Learn


    If this post helps, then please give us ‘Kudos’ and consider Accept it as a solution to help the other members find it more quickly.

    Thank you.

    • Sunray's avatar
      Sunray
      Frequent Visitor

      Hello v-kpoloju-msft Thank you for the response. The lineage is ON for fabric sources., what i realized is, if any source that is not part of OneLake, then the lineage is not available, not sure if this is a limitation in Purview for fabric?

      On the Scan Set Rules, for fabric data sources, the screen itself is not presented. If i try to create a custom scan rules, then i cannot find Fabric as a data source type in the drop-down provided, not sure why. I seem to have the latest updates from Purview.

      • v-kpoloju-msft's avatar
        v-kpoloju-msft
        Icon for Community Support rankCommunity Support

        Hi Sunray,
        After thoroughly reviewing the details you provided, I have identified few alternative workarounds that may help resolve the issue. Please follow these steps:


        It is a known limitation that Microsoft Purview supports lineage for Fabric sources in OneLake but may not extend this support to external sources like on-prem SQL, Azure SQL DB, or other non-OneLake sources. This could indeed be a limitation in the current version of Purview for Fabric, as Microsoft is still rolling out extended capabilities for lineage tracking.

        The absence of Scan Set Rules for Fabric and the inability to create custom scan rules for Fabric may indicate that Fabric is not yet fully integrated into Purview’s scanning framework.

        Create a scan rule for Azure Data Lake Storage Gen2 or Power BI, depending on the Fabric sources you are using, and see if this serves as a temporary workaround. As a temporary workaround, you might consider manually creating scan rule sets under Management Center > Scan rule sets in Purview. While Fabric-specific options may not be available, configuring general rules could provide partial functionality. I suggest monitoring their Microsoft Purview | Microsoft Learn for any improvements.

         

        Even though your Fabric registration is verified, ensure you have Scan Contributor or Purview Data Curator permissions. Certain Fabric-related features might still be rolling out based on your region. 

        New Microsoft Purview Unified Catalog deployment regions | Microsoft Learn

         

        If this post helps, then please give us ‘Kudos’ and consider Accept it as a solution to help the other members find it more quickly.

         

        Thank you.