Forum Discussion

YevgenyM's avatar
YevgenyM
Icon for Advocate IV rankAdvocate IV
1 year ago
Solved

Accessing On-Prem API via Python/PySpark in Notebooks

Hi everyone,   We have an on-prem Aruba API endpoint that's accessible through the Power BI gateway.   I'm looking to access this data using Python or PySpark within Microsoft Fabric notebooks. ...
data engineering
notebook
  • spaceman127's avatar
    spaceman127
    1 year ago

    All right.
    This is actually very often the case.

    However, we can think of two additional ideas.
    Mirroring would be another idea if you already have the data in the SQL server or, as you have already written, incremental copy with CDC to a fabric SQL database.
    Both are currently still in preview, but according to my tests they work very well.
    Unless it is critical, these would be alternatives.

     

    Best regards 

YevgenyM's avatar
YevgenyM
Icon for Advocate IV rankAdvocate IV
1 year ago

Nope, we don't have full control over azure services in the organization and prefer to stick to fabric services we do have full control over them.

 

Currently, it is most likely we write the data to on-prem MSSQL

The next step will be incremental copyjob to bronze lakehouse. 

spaceman127's avatar
spaceman127
Icon for Super User rankSuper User
1 year ago

All right.
This is actually very often the case.

However, we can think of two additional ideas.
Mirroring would be another idea if you already have the data in the SQL server or, as you have already written, incremental copy with CDC to a fabric SQL database.
Both are currently still in preview, but according to my tests they work very well.
Unless it is critical, these would be alternatives.

 

Best regards