Forum Discussion

jovianaditya's avatar
jovianaditya
Frequent Visitor
2 years ago

Spark managed table automatically update/insert

I've created a spark-managed table from a parquet source path in my ADLSgen2 as a delta table. Can my spark-managed table automatically get updated/inserted every time new data is in my ADLSgen2 sou...
data engineering
one lake
HimanshuS-msft's avatar
HimanshuS-msft
Icon for Microsoft Employee rankMicrosoft Employee
2 years ago

Hello jovianaditya 
If the ask to have the new rows / updated rows show up the delta table , then you will have to run the spark code again , You can set it on a schedule  . Its not going to be a realtime scenario .

 





Thanks 

Himanshu