Forum Discussion

HamidBee's avatar
HamidBee
Power Participant
3 years ago

How can I get Synapse Notebook to only process newly added data?

I have data that I plan on uploading to an Azure storage account. My plan is to create a pipeline in Synapse Studio, which will include an Apache Notebook (Using PySpark). The primary objective i...