topic Re: Get Table information from dataset Programmatically in Developer

Get Table information from dataset Programmatically

pgelli — Thu, 16 Jul 2020 17:12:42 GMT

Hi All,

Is there a way to programatically get the information of datasource & tables used in a dataset (like some kind of metadata).
I saw there is a GetDataSet API, but that works on the datasets that are published using REST API. It will be practically impossible for us to publish a report using REST API given the amount of data we have.

Any suggestions please?

Re: Get Table information from dataset Programmatically

lbendlin — Thu, 16 Jul 2020 18:58:21 GMT

You can use any XMLA client (like SSMS, DAX Studio, ALM Toolkit etc) to connect to the XMLA endpoint of the dataset (assuming, of course, that you have access to the dataset) and pull down all the meta data.

Re: Get Table information from dataset Programmatically

pgelli — Thu, 16 Jul 2020 19:58:32 GMT

That is good information. Thanks @lbendlin . I see that it is only supported for PowerBI premium subscriptions.
Currently we don't have PowerBI premium. Do you know of a way which can work for us with Standard PowerBI subscription & workspace.

Re: Get Table information from dataset Programmatically

lbendlin — Thu, 16 Jul 2020 22:25:46 GMT

Apologies, i did not qualify that. I have no experience outside of Premium. Maybe you need to be made a workspace member?

Re: Get Table information from dataset Programmatically

pgelli — Fri, 17 Jul 2020 00:40:14 GMT

So I got hold of a premium workspace and am able to connect to the XMLA endpoint.
So far, I could get information like tables and columns from dataset perspective.

We want to actually find the source table information, not the ones created in powerbi report/dataset. Sorry if that was not clear in my initial post.
@lbendlin is there a way to get the source table information and the actual queries which are used to create the dataset tables.

Re: Get Table information from dataset Programmatically

lbendlin — Fri, 17 Jul 2020 02:21:45 GMT

select * from $SYSTEM.TMSCHEMA_PARTITIONS

Re: Get Table information from dataset Programmatically

pgelli — Fri, 17 Jul 2020 17:57:26 GMT

Thanks @lbendlin. I tried that at I dont see information of actual source in response.
I still see the information about dataset tables, not the actual source SQL tables.

Re: Get Table information from dataset Programmatically

lbendlin — Fri, 17 Jul 2020 18:39:06 GMT

Now you got me really confused. Are you after the schema information?

See if this blog helps you.

https://blog.crossjoin.co.uk/2020/07/05/why-is-power-bi-running-my-sql-query-twice/

Re: Get Table information from dataset Programmatically

pgelli — Fri, 17 Jul 2020 18:51:36 GMT

Sorry for the confusion @lbendlin .
My need is to programatically find the list of source tables which are backing a given powerbi report.

Re: Get Table information from dataset Programmatically

lbendlin — Fri, 17 Jul 2020 21:05:03 GMT

That's what I gave you with the DMV query. You need to take that M code and parse it. It contains the server, database and query.

Re: Get Table information from dataset Programmatically

pgelli — Tue, 21 Jul 2020 15:21:07 GMT

@lbendlin , I am afraid I am getting different results for that query:

These are not the tables present in our Source. Am I missing something?

Re: Get Table information from dataset Programmatically

lbendlin — Tue, 21 Jul 2020 17:18:58 GMT

Most likely you connected to the wrong endpoint. Different dataset maybe?

Re: Get Table information from dataset Programmatically

pgelli — Wed, 22 Jul 2020 17:38:06 GMT

I verified that I am looking at right dataset. However, PowerBI report is built using "import" and not "direct query".
Does it make a difference @lbendlin ?

Re: Get Table information from dataset Programmatically

lbendlin — Wed, 22 Jul 2020 18:05:01 GMT

No, once you access the dataset it doesn't matter much if the query connection type is import/ direct query or mixed.

I just tried it with one of my direct query datasets and got the expected result.

As expected it will not work at all with live connections.

Re: Get Table information from dataset Programmatically

Anonymous — Tue, 05 Jan 2021 14:55:59 GMT

I had the same problem as @pgelli when using @lbendlin 's suggestion of SELECT * FROM $SYSTEM.TMSCHEMA_PARTITIONS; I was receiving the DAX QueryDefinitions and not the M Query defintions (super useful, just not what I needed). What solved it for me was instead using SELECT * FROM $System.DISCOVER_M_expressions. Hopefully this saves someone else some time for this use case.