"End to end" refresh

So... a very belated update from me nearly 2 years after I posted my opening question in the hope that this update will help other users.

This is how we automated the process:

1) Data comes in as csv files through a data ingest stage that the client drag and drops into our online portal (via Azure)

2) In Azure data factory I have set up pipelines and dataflows to cleanse, process and standardise the data, together with amending master tables with new data sets. Outputs to csv files and master SQL database. This is no easy task owing to the complexities and variety of the differnt data feeds but once the principle is up and running it can be used and adapted to the other data sets.

3) The PowerBI report is pointed to the 3 x master sql databases in Azure using row level security to ensure the relevant dataset is visible to the relevant users.

4) Yes I can confirm that other than the initial set up process it is completely automated, now saving our company a huge amount of time!

Any questions please let me know.