Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
5 years ago
Solved

Quick data inspection

In Pandas (Python library), you can call an inspect() function which returns details such as the total number of rows and the number of nulls and errors in each column.    Is there any similar feat...
Need Help
  • edhans's avatar
    edhans
    5 years ago

    Something else you can try Anonymous is using the built in visual components of Power Query below. Check out the View Tab in Power Query:

    • Column Quality (blue arrow) will show how many errors, empties, or valid cells there are in the current field.
    • Column Distribution (red arrow) will give an idea of how many are unique and the approx distribution of values.
    • Column Profile (green arrows) will take up half of your screen but provide a wealth of information on the selected column.
    • In the red box, you can tell the Column profile to use the full data set vs just 1,000 rows which is the default, but be forewarned, if you have a few million rows, it will take a minute to generate the profile. If you have tens of millions or hundreds of millions of records, I would not advise analysing the full data set that way unless you don't want to use your computer for a while. 😁

     

Anonymous's avatar
Anonymous
Not applicable
5 years ago

edhans Thanks, that's exactly what I was after. 

Jimmy801  unfortunately I couldn't get your solution to work; I think I may have the syntax wrong? 

 

For the table TestTable, I created a new blank query, but none of the following worked: 

 

TestTable.Profile

Table.Profile(TestTable)

TestTable.RowCount

Table.RowCount(TestTable)

 

I am guessing I misinterpreted the intended formula? Thanks. 

edhans's avatar
edhans
Community Champion
5 years ago

Anonymous do this to get Table.Profile to work.

  1. Do your query as normal.
  2. Right-click on that last step (or the step you want analyzed) and select Insert Step After
  3. In the Formula bar, wrap that in Table.Profile, so example:

 

= Table.Profile(#"Added Index")

 

Then delete that step when done with your analysis.

You can also create a new query that will always profile given query:

  1. New blank query
  2. put =Table.Profile(Queryname) in the formula bar. If the query has a space in it, it would be Table.Profile(#"Query Name") - and these are case sensitive.