How to update report data automatically

[CLCastroEn]

Hello everyone:

I have a report already ready and published in power bi so that my whole team can see the charts. The data I use is an EXCEL with many rows, more than 800,000 rows. what I have to do is weekly, save the data in the bottom rows of that EXCEL data, but excel does not support so many rows, so my idea is to add a new file in each update, that is; this week add a new excel to my sharepoint and have my report save it automatically. Then, for the next week just upload another excel file and it will also be saved to the consolidated report with all the data from all excel files that I have.

I would appreciate it if I showed the types of actions that can be done in power BI, and if you need power bi pro, no problem because I can get it. Thank you very much!

[FrankAT]

Hi @CLCastroEn 

take a look at the following page: https://powerbi.microsoft.com/de-de/blog/power-bi-desktop-june-2020-feature-summary/#_APR

Regards FrankAT

[BA_Pete]

Hi @CLCastroEn ,

1) Go to New Source then select Sharepoint Folder.

2) Navigate to the folder where all your Excel files are kept and select Combine & Load. Make sure that the only files in this folder are the ones you want to combine.

3) You will see that Power Query has set up some steps for you like this:

4) Select Transform Sample File query and you should see one of your Excel files in there. Perform all the transformations in this query that you want done to ALL of the files in the folder BEFORE they are combined e.g. Use first row as headers, Change Types etc.

5) You should see one of the queries has not been blocked from loading to the model (name is not in italic script). This is the combined result of all of your Sharepoint files. You can then perform further transformation in this query on the combined dataset.

Pete

[amitchandak]

@CLCastroEn , not very clear. refer

https://powerbi.microsoft.com/en-us/blog/combining-excel-files-hosted-on-a-sharepoint-folder/

https://medium.com/@wkrzywiec/getting-data-from-the-latest-file-in-a-folder-using-power-query-51dfa4...

https://community.powerbi.com/t5/Service/Power-BI-Get-Data-From-SharePoint-List-Library/td-p/280109

[Anonymous]

This is fine, providing your column headers are all named the same, and the format is the same, 

just go to:
* Get Data
* either "Folder" or "SharePoint Folder"

* Select the desired folder

* Click "Combine & Transform Data" 

This will bring the files into one. 

[CLCastroEn]

and can I do this without entering the power bi desktop? in order to leave these processes automated. In order to only update the sharepoint data

[BA_Pete · Accepted solution]

Hi @CLCastroEn ,

It can be done in PBI Desktop, but it can also be done in DataFlows online in the PBI Service. The example picture I attached earlier is actually from an online DataFlow implementation where I use this technique to combine millions of rows of GPS data.

Pete

[mhossain]

@CLCastroEn 

It's doable, there are multiple ways to do that. Please check below link if this helps:

https://thinkaboutit.be/2020/02/how-do-i-implement-an-incremental-refresh-in-power-bi-free-or-pro/