Forum Discussion
akkibuddy7
Helper I
1 year agoIncremental refresh For S3 shortcut
I have parquet Partitioned data in S3 and using shortcut it only pulls the files not table and to solve this I'm using Notebook to convert that into delta tables in lakehouse. But S3 data gets refres...
- 1 year ago
If you are trying to run the notebook without a pipeline use schedule from inside the notebook
spencer_sa
Impactful Individual
1 year agoFor something as straightforward as that, a pipeline with a schedule will most likely suffice.
If this helps, please consider Accepting as a Solution to help others find it more easily.