Data Lake gen2

[geoffawilliams]

Does anyone know when we will be able to use Data Lake Gen2 as a source? It is kind of strange that we can use it for dataflows, but can't pull data from other locations in the same data lake.

Thanks!!

[mckinneysooner]

Qubole an Azure ISV offers an ANSI SQL compliant open source engine with a PowerBI connector that allows direct federated query through PowerBI.  You can access data lake directly and build reports on read or do ad hoc reporting.  The size of the data can range from Gigabytes to 1 Petabyte.  Apache Presto provides in memory capabilities so response time is in order of seconds on average.  Most customer struggle with taking full advantage of low cost analytics directly on the Azure Data Lake.  No need for a DW or SQL Data Mart.

https://www.qubole.com/blog/qubole-brings-federated-queries-to-microsoft-power-bi-with-presto/

This is a Microsoft supported connector in PowerBI.  We will help you set up Qubole Presto for a free pilot in your Azure tenant and get you going.  Expedia is our largest customer with over 2,000 business analysts accessing the data lake "real-time" through their BI solutions to drive business results.  

[Anonymous]

@geoffawilliams,

What do you mean that  "can't pull data from other locations in the same data lake"? Do you want to combine data Lake Gen2 and other data sources in a single dataset?

Regards,
Lydia

[geoffawilliams]

I've got other processes landing data into the Data Lake. I cannot use files landed in Data Lake gen2 as sources in Get Data. If you try as Data Lake, it gets an error about the URI, if you try as blob you get an API error.

Thanks!!