Forum Discussion

YevgenyM's avatar
YevgenyM
Icon for Advocate IV rankAdvocate IV
1 year ago
Solved

Accessing On-Prem API via Python/PySpark in Notebooks

Hi everyone,   We have an on-prem Aruba API endpoint that's accessible through the Power BI gateway.   I'm looking to access this data using Python or PySpark within Microsoft Fabric notebooks. ...
data engineering
notebook
  • spaceman127's avatar
    spaceman127
    1 year ago

    All right.
    This is actually very often the case.

    However, we can think of two additional ideas.
    Mirroring would be another idea if you already have the data in the SQL server or, as you have already written, incremental copy with CDC to a fabric SQL database.
    Both are currently still in preview, but according to my tests they work very well.
    Unless it is critical, these would be alternatives.

     

    Best regards 

Shahid12523's avatar
Shahid12523
Icon for Community Champion rankCommunity Champion
1 year ago

You can't directly use the Power BI gateway from Fabric notebooks. Instead:
- Option A: Pull data into a Power BI dataset via the gateway, then query that dataset from Python/PySpark.
- Option B: Set up a secure cloud-accessible API (via Azure Function or reverse proxy) that talks to the on-prem Aruba API.
- Option C: Use Power Automate or a script to push Aruba API data into OneLake or a Lakehouse, then read it from notebooks.