Forum Discussion

govindarajan_d's avatar
govindarajan_d
Super User
2 years ago

Running Vacuum on Lakehouse table throws error

Hi All,

 

I have been trying to run vacuum on multiple tables using both Adhoc maintenance option as well as Spark and I am getting the following error:

 

 

These tables are updated by Dataflow Gen 2 on a daily basis. The dataflow was running fine without issues for past 1 month.

data engineering

11 Replies

    • govindarajan_d's avatar
      govindarajan_d
      Super User
      2 years ago

      Hi AndyDDC ,

      This is the first time I am running VACUUM on these tables. 

      For few other tables that have been updated by Spark, VACUUM works fine. Two tables that are updated by Dataflow Gen 2 throws the error. 

      • AndyDDC's avatar
        AndyDDC
        Most Valuable Professional
        2 years ago

        govindarajan_d I've tested using a Dataflow Gen2 to load into a Delta table and then ran the VACUUM command and it worked successfully.  What version of Spark are you using in the workspace that the lakehouse is in?

  • VincentMeyers's avatar
    VincentMeyers
    Frequent Visitor
    2 years ago

    I got exactly the same problem for all my tables in my lakehouse, coming from dataflows

  • Anonymous's avatar
    Anonymous
    Not applicable
    2 years ago

    I got the same problem