Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Get certified in Microsoft Fabric—for free! For a limited time, get a free DP-600 exam voucher to use by the end of 2024. Register now

Reply
Filip_analyst
Frequent Visitor

PowerQuery - Table.Profile() not able to calculate

Hello,

I have the following problem with Table.Profile() function. 
Standard output is as follows:

Filip_analyst_0-1661414705072.png

I need to perform Table.Profile() on table that has 130 columns and around 2 milion of rows (I need to know only Count and Null Count basically for each column. The rest of statistics is not required). With that, Table.Profile() is not able to handle (timout error). Unfortunately the action needs to be done on the whole table (business requirement).

Is there any way to calculate this in PowerQuery instead of on a database directly with T-SQL?
Appreciate any tips!



2 REPLIES 2
Filip_analyst
Frequent Visitor

Thank you for quick answer.

I did a manual work, but the problem is not solved. In order to perform transformations PowerBI needs to switch from Direct Query to Import Node so all calculations are performed locally. I did several tests but it takes too long, so can not accept it. Finally, we wrote a T-SQL procedure to calculate the KPI's

HotChilli
Super User
Super User

I'm reasonably sure you can write your own version.

Unpivot the columns and Add a Custom Column (if value is "" then 1 else 0)

perform a 'Group By' with 2 aggregations (Count rows and Sum of the custom column)

Let me know how you get on

Helpful resources

Announcements
November Carousel

Fabric Community Update - November 2024

Find out what's new and trending in the Fabric Community.

Live Sessions with Fabric DB

Be one of the first to start using Fabric Databases

Starting December 3, join live sessions with database experts and the Fabric product team to learn just how easy it is to get started.

Las Vegas 2025

Join us at the Microsoft Fabric Community Conference

March 31 - April 2, 2025, in Las Vegas, Nevada. Use code MSCUST for a $150 discount! Early Bird pricing ends December 9th.

Nov PBI Update Carousel

Power BI Monthly Update - November 2024

Check out the November 2024 Power BI update to learn about new features.