Folder Data Source Will Not Refresh - PLEASE HELP

[kboyd]

I am attempting to test and implement a folder data source dataset.  I have the folder path setup under as a data source under the gateway.  It does recognize this is the correct path within the settings Gateway Connection (screenshot below). 

However I am unable to complete any refreshes to this dataset (bottom screenshot).  I have tried multiple things:

• Different files.
• Only using 1 file within the folder.
• Clearing permissions to the data source.
• Moving the filter step to later in the transform process.
• I have deleted the Change Step (still believe the merge within this step is my problem source).

I get the error below regardless of the file, I can even delete the column it says is causing the issue and it will just grab a new column.  The files them selves are very simple csv files with only about 10 columns and maybe a 1000 rows.  I have a suspicion when you use the folder data source it does a merge as part of the ETL process and there is some nuiance about this that I am not aware of.  It seems from the connection end everything is fine.  I have created visuals within PBI desktop for these files and they load properly, I am able to publish the file to the webapp and see the visual.  I just can not perform a refresh.  All help is appreciated.

[kboyd · Accepted solution]

I was able to work through this issue.  The problem was I was selecting the file from the folder the incorrect way which was causing some merge issues.  Thank you all for the quick responses.

[v-yueyunzh-msft]

Hi , @kboyd 

According to your error details, you have encountered the problem that the column "month_yr" from a table cannot be found during data refresh, according to my experience and research, you can try the following operations to confirm that the problem occurs root place:

1. You can try to download the report as a local .pbix file first and open it for a refresh
2. If the refresh reports an error, you can first go to Power Query to find the query with the problem and fix it.
3. If the refresh is successful, then we consider that the problem occurs in some row and column conversion operations in your query, because the refresh in Power BI desktop is a schema refresh, even if the data source data model of the source side changes, it can be refreshed successfully, but on the service is pure data refresh, the data source has any data model changes (such as column name change, column deletion, column order change, table name change) will have problems. You need to continue to research and troubleshoot these possible problem points
4. Here are some case links related to errors, you can refer to:

Solved: Re: Removing any columns causes errors - Microsoft Power BI Community

Solved: Getting 'the column of the table wasn't found' eve... - Power Platform Community (microsoft....

Solved: Column not found when refreshing dataflow from web... - Power Platform Community (microsoft....

Thank you for your time and sharing, and thank you for your support and understanding of PowerBI! 

Best Regards,

Aniya Zhang

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly

[AnkitKukreja]

Hi @kboyd 

Probably an issue with the model. Is it possible for you to share the sample file so I can try and set it up on my end?

Please ensure to remove PII columns and share the data if possible.