Forum Discussion

VIvMouret's avatar
VIvMouret
Frequent Visitor
1 year ago
Solved

Download Lakehouse Files

Hi everyone! From a notebook in the default Spark environment, I save a table in the same lakehouse as a file I need to create an application that retrieves existing files from the Lakehouse files,...
API for GraphQL
lakehouse
notebook
  • VIvMouret's avatar
    VIvMouret
    1 year ago

    Update of my problem:
    All the technologies I've seen above (unless I'm mistaken) only serve to update and send new data to a Lakehouse, and that's not what we're looking for here.

    To answer my question, which is :
    I need to make the files I've created available to colleagues

    Well, to do this, I changed direction: OneLake

    I had to assign specific and restricted roles, install OneLake on all the machines so that each PC then had access to the desired folder
    By pushing the files into a new Lakehouse, a new workspace and managing the roles, I was able to export the data.

    However, I'm only keeping all this for development, I wouldn't recommend it for production.

    I have other ideas for putting the export of Lakehouse files into production, such as with Power Pages, but as I can't find any way of extracting the files at the moment, the idea has been put off.

    If anyone comes up with an alternative method, don't hesitate !

VIvMouret's avatar
VIvMouret
Frequent Visitor
1 year ago

thank you for your quick reply!
I'm going to test and try with ADLS Gen-2 as I already have the GraphQL API ready.

nilendraFabric's avatar
nilendraFabric
Super User
1 year ago

Thanks VIvMouret please keep me posted. This is intresting to learn about this usecase.

  • VIvMouret's avatar
    VIvMouret
    Frequent Visitor
    1 year ago

    I've just tested your code, but I can't access the "files" properties

    When I search in "Get data", I don't have direct access to the Lakehouse files
    Will I normally be able to view the files in the Lakehouse?

    Because I can't see them..

    I still need to check that I have read-only permissions for the API

    • nilendraFabric's avatar
      nilendraFabric
      Super User
      1 year ago

      Hi VIvMouret 

      I have tried the Graphql query too, its not working. So you are correct here that it is not supported, I am trying few other things will share soon.

      And it seems like you have only access to tables from GraphQL api , not to files. SO we have to figure out different approach to query files.

      Thanks