topic Re: ADLS table shortcut SQL endpoint error in Data Engineering

ADLS table shortcut SQL endpoint error

simtali — Wed, 11 Dec 2024 12:33:17 GMT

My lakehouse contains several shortcuts to delta tables that are all in the same ADLS Gen 2 container, and they all work fine except one, which gives the error below when I try to access it from the SQL endpoint (though lakehouse preview works). The delta tables are being created by a data flow, and there are no indications of failures. The only notable difference between this table and the others that work is the number of columns, 490, which is within the documented limit of 10,000. Are there any steps I can take to troubleshoot this, or logs that would provide more detailed information about the cause?

Re: ADLS table shortcut SQL endpoint error

lbendlin — Thu, 12 Dec 2024 00:55:15 GMT

If you have a Pro license you can open a Pro ticket at https://admin.powerplatform.microsoft.com/newsupportticket/powerbi
Otherwise you can raise an issue at https://community.fabric.microsoft.com/t5/Issues/idb-p/Issues .

Re: ADLS table shortcut SQL endpoint error

Anonymous — Thu, 12 Dec 2024 06:18:38 GMT

HI @simtali,

I suppose this may related other table data size and sql endpoint I/O limits. Have you checked on the data source settings to confirm if they meet to the limitations?
Regards,

Xiaoxin Sheng

Re: ADLS table shortcut SQL endpoint error

simtali — Thu, 12 Dec 2024 15:02:07 GMT

Hi Xiaoxin,

Thanks for your response. What are the data source settings and limitations you're referring to?

If these are the limitations you have in mind, none of them apply.

Re: ADLS table shortcut SQL endpoint error

Anonymous — Tue, 17 Dec 2024 07:04:41 GMT

HI @simtali,

In fact, I mean the limitation that enabled on the data source side. If you are interesting about these, perhaps you can check the following links:

Best practices for using Azure Data Lake Storage - Azure Storage | Microsoft Learn

Azure datalake storage Gen2 : Maximum Number of Files/second that we can create - Microsoft Q&A

Regards,

Xiaoxin Sheng