Can you directly query a verion of Azure Datalake Gen 2?

[DebbieE]

Hi all

I've been reading about how to connect to an Azure Data Lake Gen 2

I have been thinking in terms of composite modeling. So importing a model at say month level which is mostly what users are interested in.

But for those who want to drill down to see granuar-level data they can actually look directly at the data lake below the data model.

Obviously I know you can do this if the data was in for example SQL Server. I was wondering if it was a possibility with a data lake?

[mwegener]

Hi @DebbieE ,

I think you need an appropriate SQL endpoint.

There is probably something going on with Azure Synapse.

[DebbieE]

thats a real shame if you dont want to go the Synapse route and just want to use a data Lake Gen 2. Some clarification would be really good I think

[mwegener]

It would be exciting to see how the dataflows features "Azure Data Lake integration" and "enhanced compute engine" play together.

Unfortunately, I don't have any premium capacity available.

https://docs.microsoft.com/en-us/power-bi/transform-model/service-dataflows-azure-data-lake-integrat...

https://docs.microsoft.com/en-us/power-bi/transform-model/service-dataflows-enhanced-compute-engine

[mwegener · Accepted solution]

According to Microsoft documentation, Azure Data Lake Storage Gen2 does not support Direct Query.

https://docs.microsoft.com/en-us/power-bi/connect-data/power-bi-data-sources

[mwegener]

Do you work with dataflows and the CDM structure?

I think the problem is that the data in the ADLS Gen2 is stored in a blob in an unstructured manner.

For Direct Query, an engine would have to be able to load and filter the data in the source (ADLS Gen2).