Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
5 years ago
Solved

Quick data inspection

In Pandas (Python library), you can call an inspect() function which returns details such as the total number of rows and the number of nulls and errors in each column.    Is there any similar feat...
Need Help
  • edhans's avatar
    edhans
    5 years ago

    Something else you can try Anonymous is using the built in visual components of Power Query below. Check out the View Tab in Power Query:

    • Column Quality (blue arrow) will show how many errors, empties, or valid cells there are in the current field.
    • Column Distribution (red arrow) will give an idea of how many are unique and the approx distribution of values.
    • Column Profile (green arrows) will take up half of your screen but provide a wealth of information on the selected column.
    • In the red box, you can tell the Column profile to use the full data set vs just 1,000 rows which is the default, but be forewarned, if you have a few million rows, it will take a minute to generate the profile. If you have tens of millions or hundreds of millions of records, I would not advise analysing the full data set that way unless you don't want to use your computer for a while. 😁

     

Jimmy801's avatar
Jimmy801
Community Champion
5 years ago

Hello Anonymous 

 

Try Table.Profile ( create a new query and input you queryname into this function). When you just need the rows use Table.RowCount.

 

If this post helps or solves your problem, please mark it as solution (to help other users find useful content and to acknowledge the work of users that helped you)
Kudoes are nice too

Have fun

Jimmy

  • Anonymous's avatar
    Anonymous
    Not applicable
    5 years ago

    Thanks, will look into that solution asap and report back. Appreciated. 

    • edhans's avatar
      edhans
      Community Champion
      5 years ago

      Something else you can try Anonymous is using the built in visual components of Power Query below. Check out the View Tab in Power Query:

      • Column Quality (blue arrow) will show how many errors, empties, or valid cells there are in the current field.
      • Column Distribution (red arrow) will give an idea of how many are unique and the approx distribution of values.
      • Column Profile (green arrows) will take up half of your screen but provide a wealth of information on the selected column.
      • In the red box, you can tell the Column profile to use the full data set vs just 1,000 rows which is the default, but be forewarned, if you have a few million rows, it will take a minute to generate the profile. If you have tens of millions or hundreds of millions of records, I would not advise analysing the full data set that way unless you don't want to use your computer for a while. 😁

       

      • Anonymous's avatar
        Anonymous
        Not applicable
        5 years ago

        edhans Thanks, that's exactly what I was after. 

        Jimmy801  unfortunately I couldn't get your solution to work; I think I may have the syntax wrong? 

         

        For the table TestTable, I created a new blank query, but none of the following worked: 

         

        TestTable.Profile

        Table.Profile(TestTable)

        TestTable.RowCount

        Table.RowCount(TestTable)

         

        I am guessing I misinterpreted the intended formula? Thanks.