Forum Discussion

Anonymous's avatar
Anonymous
Not applicable
5 years ago
Solved

Quick data inspection

In Pandas (Python library), you can call an inspect() function which returns details such as the total number of rows and the number of nulls and errors in each column. 

 

Is there any similar feature in Power Query? 

 

In particular, I like knowing exactly how many rows there are in each query, as I can then use this as a quick way to check if a merge has worked as expected. 

 

The attached photo shows an example of '999+' rows, which is not that useful! I appreciate that it may not be practicable to actually load millions of rows at a time, but surely just getting the number of rows is an easier task in computational terms? 

 

Thanks.

  • edhans's avatar
    edhans
    5 years ago

    Something else you can try Anonymous is using the built in visual components of Power Query below. Check out the View Tab in Power Query:

    • Column Quality (blue arrow) will show how many errors, empties, or valid cells there are in the current field.
    • Column Distribution (red arrow) will give an idea of how many are unique and the approx distribution of values.
    • Column Profile (green arrows) will take up half of your screen but provide a wealth of information on the selected column.
    • In the red box, you can tell the Column profile to use the full data set vs just 1,000 rows which is the default, but be forewarned, if you have a few million rows, it will take a minute to generate the profile. If you have tens of millions or hundreds of millions of records, I would not advise analysing the full data set that way unless you don't want to use your computer for a while. 😁

     

5 Replies

  • Jimmy801's avatar
    Jimmy801
    Community Champion

    Hello Anonymous 

     

    Try Table.Profile ( create a new query and input you queryname into this function). When you just need the rows use Table.RowCount.

     

    If this post helps or solves your problem, please mark it as solution (to help other users find useful content and to acknowledge the work of users that helped you)
    Kudoes are nice too

    Have fun

    Jimmy

    • Anonymous's avatar
      Anonymous
      Not applicable

      Thanks, will look into that solution asap and report back. Appreciated. 

      • edhans's avatar
        edhans
        Community Champion

        Something else you can try Anonymous is using the built in visual components of Power Query below. Check out the View Tab in Power Query:

        • Column Quality (blue arrow) will show how many errors, empties, or valid cells there are in the current field.
        • Column Distribution (red arrow) will give an idea of how many are unique and the approx distribution of values.
        • Column Profile (green arrows) will take up half of your screen but provide a wealth of information on the selected column.
        • In the red box, you can tell the Column profile to use the full data set vs just 1,000 rows which is the default, but be forewarned, if you have a few million rows, it will take a minute to generate the profile. If you have tens of millions or hundreds of millions of records, I would not advise analysing the full data set that way unless you don't want to use your computer for a while. 😁