Folder Data Refresh

[JamesLow]

Hi,

I have a dashboard that reads a csv file from a folder and will only read the most recent file within the folder. I have a new csv file with different columns and when i have now refreshed the data, these new columns have not been registered within the dashboard and is still showing the old columns with titles but with the new data.

[v-yingjl · Accepted solution]

Hi @JamesLow ,

When you load the latest file into power query, the number of colums has been wriiten into the function so that you can only see the new data when adding rows data. However, if you add new columns data into the file, you need to change the column number of the function in power query as you needed:

Best Regards,
Yingjie Li

If this post helps then please consider Accept it as the solution to help the other members find it more quickly.

[swise001]

@JamesLow 

If the structure of the CSV files (including the column headers) has changed - it's likely that your Power Query needs to be updated/adjusted - as it tends to use a 'fixed' range for CSV files.  For example - if your original CSV file had 30 columns - that "30" is hardcoded in the import.  So if your new files have 35 columns - the last 5 will be missing until you adjust the scope. 

Additionally - column headers are fundamental to have Power Query looks for and grabs info.  It's not clear how much your headers are being used during the import - as it doesn't appear that it's breaking - so you may want to go into those steps to see what's happening to your new headers when compared to the old ones.  

This will likely all be solved by examining the query editor steps used for this import. 

[amitchandak]

@JamesLow , new column means new rows of data. And Dashboard means you are lloking at power service.

If there is an issue at power bi service. make sure the scheduler refresh is running there. Clear cache and check again.

If it is for the desktop . open Power query /transform data mode and check for any error

refer how to handle error in power query
https://www.youtube.com/watch?v=OE6DPmKqN7s
https://www.youtube.com/watch?v=9-Lag0VOiTs

debug issue
https://www.youtube.com/watch?v=OE6DPmKqN7s