Forum Discussion
varunaggarwal30
9 years agoFrequent Visitor
Incremental Load from Azure Data Lake
Hi , I am new to PowerBI. I have a question. My organization has a requirement to load data in azure data lake and connect power bi with data lake. The input files I get needs to be clenaed and t...
varunaggarwal30
9 years agoFrequent Visitor
Hi ,
I am new to PowerBI. I have a question. My organization has a requirement to load data in azure data lake and connect power bi with data lake. The input files I get needs to be clenaed and transformed? I am having hard time to understand the data flow. If all the cleansisng happens in powerBI then how will I be able to do incremental load? Every month file structure will be same if they et appended in data lake , it will be difficult to do clean up. Is there any middleware I need to use for ETL process or any other way of doing it better?
Thanks