Continually Updated Data Inputs, Multiple Filetypes

[Anonymous]

Hi all,

I'm working on building a dashboard for a client, and I could use some advice as to the best way to input their data. They will be sending us both CSV and TXT files that are updated monthly, and they all need to be appended into a single table. What would be the best way for me to ensure that all of the new data files are successfully and efficiently added to the "master" append table? I will have quite a few calculations running off of this table as well.

Thanks in advance!

[amitchandak]

@Anonymous , Try if these can help

https://blog.crossjoin.co.uk/2020/04/13/keep-the-existing-data-in-your-power-bi-dataset-and-add-new-data-to-it-using-incremental-refresh/

https://www.thebiccountant.com/2017/01/11/incremental-load-in-powerbi-using-dax-union/

[Anonymous]

@amitchandak Thank you! Do you have any thoughts on how best to upload the data? We recieve CSV and TXT files monthly, so my thought was to add them all to a folder, and use Get Data > Folder to import.

[amitchandak · Accepted solution]

@Anonymous , You can use any of the formats. If there is column where you expect "," to part of the value use tab-delimited \t file or some other delimiter. CSV is a standard format. If the text is enclosed in double-quotes you can have a comma in text.  The number should be formatted. 

Refer these too

https://powerbi.microsoft.com/en-us/blog/combining-excel-files-hosted-on-a-sharepoint-folder/

https://medium.com/@wkrzywiec/getting-data-from-the-latest-file-in-a-folder-using-power-query-51dfa4bff711