Forum Discussion
How can I build a data warehouse?
I know very little about actual data sync. MS has a tool for this, and I know there are third party tools to sync between various data sources, like SQL, SharePoint List, etc. to Azure. You'd just need to do a bit of searching, or head to the Azure community on the MS tech forums. I know someone there will have hands-on experience with this and can assist.
Thank you for your input and insight.
The only other question I have, to build the data warehouse, should we host it as a separate database or is there value to pushing this data into azure.
If there is value going the azure route, where should I read up to know how to push the data regularly from SQL / Excel in this data warehouse and to do my queries off of this data warehouse.
Your assistance is much appreciated.
Community ChampionDepends on your need. Advantages to Azure SQL are it is in the cloud, has insane uptimes, and is available from anywhere you have internet access. Advantages to SQL on prem is you control the server.
You'd need to do some general googling and research on pros and cons of each. But you can download for free SQL Server 2019 and install as a developer and start tinkering around with it. 100% free forever, but you are limited to 10 connections at a time (I think - that number may have changed) and it is strictly for development work, not production. But if you decide to keep it, just buy and apply a license. Then it becomes your production server. Nothing to upgrade or reinstall.
Thanks edhans
Lastly, I already have data in a production SQL database as well as in some spreadsheets.
What would the recommended method be to regularly update this information to the Data warehouse? Ideally this would be in azure to not have any impact on the production environment.
Is there a tool that can be used to simply push the data across or what do I need to look into to do this?
Thank you for all your answers, I really appreciate your time.
- edhans
I know very little about actual data sync. MS has a tool for this, and I know there are third party tools to sync between various data sources, like SQL, SharePoint List, etc. to Azure. You'd just need to do a bit of searching, or head to the Azure community on the MS tech forums. I know someone there will have hands-on experience with this and can assist.