Forum Discussion
Power ParticipantKusto Query Limits
Hi,
Kusto has a limit of 64MB on the queries.
How can we go over this limit in Fabric?
I read about Data Export but I believe it's related to Azure Data Explorer, not Fabric.
I imagine Pipelines and Dataflows Gen2 are tied to the 64MB limit? Is the copy activity tied to this limit as well ?
Kind Regards,
Dennes
Hi DennesTorres
Yes there are ways to deal with this with commands https://learn.microsoft.com/en-us/azure/data-explorer/kusto/concepts/query-limits#limit-on-result-set-size-result-truncation.
You can try like this:set notruncation;
MyTable | take 1000000
Even in Fabric, KQL DB automatically makes the data available in OneLake in delta format.Hi,
I think it worked.
It resulted in an error on the UI, but I believe it will work in othe places.Meanwhile I discovered the pipelien COPY activity ignores the Kusto query limit automatically, without the need of this set.
On the other hand, the dataflows gen 2 are tied with kusto limit, probably they will need this set.
Thank you!
Dennes
4 Replies
Hi DennesTorres
Thanks for using Fabric Community.
At this time, we are reaching out to the internal team to get some help on this. We will update you once we hear back from them.
ThanksHi DennesTorres
Yes there are ways to deal with this with commands https://learn.microsoft.com/en-us/azure/data-explorer/kusto/concepts/query-limits#limit-on-result-set-size-result-truncation.
You can try like this:set notruncation;
MyTable | take 1000000
Even in Fabric, KQL DB automatically makes the data available in OneLake in delta format.
DennesTorresHi,
I think it worked.
It resulted in an error on the UI, but I believe it will work in othe places.Meanwhile I discovered the pipelien COPY activity ignores the Kusto query limit automatically, without the need of this set.
On the other hand, the dataflows gen 2 are tied with kusto limit, probably they will need this set.
Thank you!
Dennes
- UriBarash
Microsoft Employee
Data export and continuous exports are available in Eventhouse (Kusto) exactly the same as in ADX and more, with data landing in Delta/Parquet in the lake as the eventhouse is part of the lake.