Forum Discussion

Umasankar_Sane's avatar
Umasankar_Sane
Frequent Visitor
1 year ago
Solved

Reading data from Lakehouse Delta table

Hi ,   Can we read data from Lakehouse Delta table with Fabric capacity turned off .    Now in Architecture I am planning to keep Silver layer in Lakehouse so that ML model can refer it . But ...
  • v-hashadapu's avatar
    v-hashadapu
    1 year ago

    Hi Umasankar_Sane , thank you for reaching out to the Microsoft Fabric Community Forum.

    It appears that the ability to access the Lakehouse Delta tables is indeed tied to the Fabric capacity being active. The error message "Unable to complete this action because this fabric capacity is currently not active" indicates that the infrastructure managing the data needs to be running for access to occur, even though Delta Lake itself is an open-source format.

    Please consider below steps to consider to ensure that your client's data isn't vendor-locked:

    1. Regularly export the Delta tables to an open format such as Parquet, CSV, or JSON. These formats can be easily read by other platforms without relying on specific infrastructure. Automate this process using tools like Apache Spark or Databricks to ensure data is always available in open formats.
    2. Employ Delta Lake tools such as Delta Standalone, Delta Rust, or Delta Lake on Apache Spark. These tools allow you to access Delta tables without depending on proprietary systems. Ensure that these tools are tested and integrated into your architecture.
    3. Design your architecture to support data portability. This includes using open-source data processing frameworks and avoiding proprietary dependencies as much as possible. Regularly back up and test the migration of data to other systems to ensure seamless transitions if needed.

     

    If this helps, please consider marking it 'Accept as Solution' so others with similar queries may find it more easily. If not, please share the details.
    Thank you.