Forum Discussion

barabum's avatar
barabum
Frequent Visitor
7 years ago

Analyzing Big Data

I have a dataset, containing products and categories (it is an example). There are tens of millions of products and thousands of categories.   Every product has a category and other columns with a...
Need Help
v-chuncz-msft's avatar
v-chuncz-msft
Community Support
7 years ago

barabum,

 

It seems to work. You may try using SQL Profiler.

barabum's avatar
barabum
Frequent Visitor
7 years ago

SQL Profiler is deprecated and doesn't work with Azure SQL Server.

I used sys.dm_exec_query_stats and sys.dm_exec_sql_text views to see actual ueries. They look like this one, where <ListOfColumns> are other columns:

 

 

SELECT TOP (1000001) 
[t12].[CompositeKey],<ListOfColumns> 
FROM ( (select [$Table].[CompositeKey] as [CompositeKey], <ListOfColumns> ) AS [t12] 
GROUP BY [t12].[CompositeKey],<ListOfColumns>

 

 

There is no WHERE clause in the query, so it tries loading all data.

Table component shows this error:

Error Message:
The resultset of a query to external data source has exceeded the maximum allowed size of '1000000' rows.