Certain dataset tables/columns are not returned from the Admin - WorkspaceInfo GetScanResult endpoin

[brechtarnou]

Hi all,

When we use the power bi api for fetching the metadata of a certain power bi system, not all metadata is returned as would be expected. Certain datasets do not return their tables and columns. We are not able to pinpoint why some datasets do return all their metadata and others don't. We use the Admin - WorkspaceInfo GetScanResult endpoint.

The workspace was newly created for the testing purpose and the datasets are recently published.

Does anyone have the same issue?

If there is extra information required, I can always ellaborate more.

Thanks in advance.

Kind regards,

Brecht

[brechtarnou]

Hi,

If I am not mistaken it was because of we uploaded the file directly to app.powerbi.com and didn't go via desktop and published it.

Kind regards,

Brecht

[jpretorius]

Hi @brechtarnou,

In order for the tables to be populated in the WorkspaceInfo GetScanResult the dataset needs to have been refreshed at least once in the Power BI Service. 

Hope that helps

Best regards

James

[brechtarnou]

Hi @jpretorius,

The issue is only occuring when we upload an excel file directly from the app.portal.powerbi.

If we refresh we still are not able to see the columns of that dataset.

If we upload the exact same file via the desktop app, we can find our columns that are in our dataset.

Thanks in advance.

Kr,

Brecht

[V-lianl-msft]

Hi @brechtarnou ,

If you set the datasetSchema or datasetExpressions parameters to true , you must fully enable metadata scanning in order for data to be returned. For more information, see Enable tenant settings for metadata scanning.

What type of authentication are you using?

The user must have administrator rights (such as Microsoft 365 Global Administrator or Power BI Service Administrator) or authenticate using a service principal.

Here is the blog for your reference:

https://debbiesmspowerbiazureblog.home.blog/category/power-bi-admin-scanner-api/ 

Best Regards,
Liang
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

[brechtarnou]

Hi Liang,

We use the service principal to authenticate.

All the steps of the blog were also followed. We have enabled both flags for our security groups.

The thing is that we have certain datasets that return all the metadata, having the tables and the columns/measures. Other datasets in the same workspace do not return all the metadata.

But we cannot see a clear reason why certain datasets return their metadata and others not.

Kind regards,

Brecht

[vivien57]

Hello,

I have exactly the same problem, some return metadata for tables/columns and not others.

Even though they are both schedulers in the service.

Have you found the source of the problem?

Thanks in advance for your return,

Vivien