Forum Discussion

Neka's avatar
Neka
Icon for Helper III rankHelper III
1 year ago
Solved

Comparing data between a semantic model and an on-prem cube

Hello,  Not sure if this is the correct place to ask but I have a question:   Our company is migrating from on-premises SQL Server Analysis Services to Fabric Semantic Models. We are developing ou...
  • Anonymous's avatar
    Anonymous
    1 year ago

    Hi Neka ,

    Here are some of my personal thoughts on your question:

     

    1. Effective Architecture for Automating Data Comparisons

    1). Use Fabric Data Factory to extract data from both the on-premises SSAS and the Fabric Semantic Model.
    For on-premises SSAS, you can use the Self-Hosted Integration Runtime to securely connect and extract data.

    2). Perform necessary transformations using Fabric Data Factory pipelines. This can include data cleaning, normalization, and formatting to ensure consistency between the two datasets.

    3). Store the transformed data in a Lakehouse or Warehouse within Fabric.
    Use Fabric Notebooks to write comparison scripts. These notebooks can leverage Spark or Pandas to perform detailed data comparisons, checking for discrepancies in measures, dimensions, and other key metrics.

     

    2. Feasibility of Connecting to Both Sources from Fabric Data Factory Using Notebooks

    Currently, Fabric Notebooks do not directly support connecting to on-premises databases through the Power BI Gateway. However, you can use a workaround by creating a Shortcut in Fabric Lakehouse for your external data. This allows you to query the data using notebooks.

    You can look at this topic below:

    Ingesting on premise data with notebooks - Microsoft Fabric Community

     

     

     

    Best Regards

    Yilong Zhou

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

  • Anonymous's avatar
    Anonymous
    1 year ago

    Hi Neka ,

    I found a related topic, maybe it can help you.

    You can read it according to your needs:

    Solved: SSAS in Fabric - Microsoft Fabric Community

     

     

    Best Regards

    Yilong Zhou

    If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.