Forum Discussion
Notebook delta table merge operation error: Cannot seek after EOF
Does it work if you automate the table maintenance?
E.g. by scheduling a Notebook to run OPTIMIZE on the tables at a pre-defined interval?
- ntimmerman1 year agoHelper I
Hi frithjof_v , Thanks for the suggestion. Yes, that's a good idea. I've implemented a table maintenance notebook that does this. However, it's difficult to determine when an optimize needs to happen. I had now done it when the last optimize was more than 7 days ago. however, sometimes I run into this issue less than a day after the previous time. So, do I need to schedule the table maintenance twice a day? That sounds like a lot of overhead and just not right. It's pretty frustrating to open the monitor every morning and find that jobs have failed again because of this issue...
- frithjof_v1 year agoCommunity Champion
To be honest I don't have too much practical experience with it.
How often is the merge operation running?
(I'm wondering how often data is added/changed in your delta table)
- ntimmerman1 year agoHelper I