topic Scanner API Power BI - Script Pyspark (Notebook) in Developer

Scanner API Power BI - Script Pyspark (Notebook)

Charline_74 — Mon, 25 Mar 2024 09:51:51 GMT

Hello,

Has anyone managed to set up the Power BI API scanner using Pyspark in a notebook Fabric?

Merci d'avance,

Charline

Re: Scanner API Power BI - Script Pyspark (Notebook)

lbendlin — Mon, 25 Mar 2024 19:56:14 GMT

what are you ultimately trying to achieve?

Re: Scanner API Power BI - Script Pyspark (Notebook)

Charline_74 — Tue, 26 Mar 2024 07:26:33 GMT

Hi @lbendlin,

My aim is to collect the information reported by the Scanner API every day in order to monitor Power BI activities.

I'm already using the Scanner API with a Data Pipeline and Dataflow Gen2, but the Dataflow Gen2 takes too long to refresh, so I want to test the Notebook Fabric, but I'm not very comfortable with Python.

With this script, I'd like to run the various APIs of the Scanner API and then retrieve the information in the delta table format.

Re: Scanner API Power BI - Script Pyspark (Notebook)

lbendlin — Tue, 26 Mar 2024 19:56:25 GMT

The usual process is to run the Scanner API calls from Powershell and store the resulting JSON files somewhere where they can be ingested from. There's not really a point doing this from within Power BI/Fabric.

Re: Scanner API Power BI - Script Pyspark (Notebook)

kdoherty — Tue, 21 May 2024 10:35:44 GMT

I think it makes perfect sense to do this from within Fabric. Why not centralize your workflow in Fabric, rather than collecting data using one technology (PowerShell), and processing it in another (Fabric).