Forum Discussion

iLikeAzureSQL's avatar
iLikeAzureSQL
Icon for Helper I rankHelper I
7 years ago

Append Data to existing table

HI everyone,  I'm loading data from Web Data soruce into a table called LOADTABLE, I need to maintain the hsotorical loads into another table like MYDATA and append data into this table everytime I ...
Need Help
v-jiascu-msft's avatar
v-jiascu-msft
Icon for Microsoft Employee rankMicrosoft Employee
7 years ago

Hi Pat,

 

The incremental refresh has one precondition that is the data should be stored in the source. But it seems the source only has the latest data in your description. 

Did you do to improve the performance of refreshing?

 

 

Best Regards,

iLikeAzureSQL's avatar
iLikeAzureSQL
Icon for Helper I rankHelper I
7 years ago

I'm not following you! 

I need to connect to Web Data source ( like https://finance.yahoo.com/quote/MSFT) and grab a table and store in a table, the next time I refresh I need to grab new data and append to previously collected records with a timestamp, soemthing like building a qutoa collections over the time.

 

-Pat