Forum Discussion

rtolsma's avatar
rtolsma
Helper I
1 year ago
Solved

Maintenance on Lakehouse Tables

Hi,   I'm trying to run Maintenance on Lakehouse tables that are in OneLake.  However, when I try and run Maintenance on the table with only the Optimize and V-Order flag selected I receive the fol...
data engineering
lakehouse
  • richbenmintz's avatar
    richbenmintz
    1 year ago

    Hi rtolsma ,

    I believe the issue is that the Dataverse data is not actually managed by Fabric, tables are pointers to your dataverse environment, the error while annoying is correct.

     

richbenmintz's avatar
richbenmintz
Resident Rockstar
1 year ago

The Create table should not duplicate the data,

spark.sql(f"""create table {table_name}
            using delta
            location '{delta_folder_path}'"""
        )

as it is pointing to an existing delta location, should simply create a metadata entry into the Fabric Lakehouse Catalog, could you humor me and show me the properties of one of the tables, would look something like

 

Leemor1975's avatar
Leemor1975
New Member
1 year ago

Hey richbenmintz,

 

I'm fighting this same issue and wanted to share the results of creating a new table that points to the existing files. 

 

I created the table using this:

create table mserp_taxtransbientitydhs
using delta
location 'abfss://[email protected]/dataverse_operationstm_cds2_workspace_xxxxxxxxxxxxxxxxxxxxxxxxxxx.Lakehouse/Tables/mserp_taxtransbientity'

 

Unfortunately, it still gives the error "

MethodNotAllowed, "This operation is not supported through shortcuts of account type Dataverse.""

Was worth a shot! Thanks for all your sugegstions on this one.

 

Darin