Forum Discussion
Work around small API Limits - 2000 API calls per hour for dot digital
Hi. We can talk about the architecture to implement historical data. However we can't say if dotdigital will let you do it easily because that's a third party tool.
The best way to build historical API data is loading a storage. You can create scripts in Azure Functions, Runbooks or even usar Azure Data Factory to get data from API and insert in storage. The storage is up to you. You can use Data Lake Gen2, Databases, etc.
That way you can store the data of the results every day until you just run the minimum amount of requests per day to get the most recent data to the store.
I hope that helps,
Hi. We can talk about the architecture to implement historical data. However we can't say if dotdigital will let you do it easily because that's a third party tool.
The best way to build historical API data is loading a storage. You can create scripts in Azure Functions, Runbooks or even usar Azure Data Factory to get data from API and insert in storage. The storage is up to you. You can use Data Lake Gen2, Databases, etc.
That way you can store the data of the results every day until you just run the minimum amount of requests per day to get the most recent data to the store.
I hope that helps,