Adding Incremental Refresh Parameters Error Due to Binary Column

[rahul_ferns]

Hello Experts

I have connected multiple CSV files on SharePoint and it works and now wanted to add incremental refresh due to the size of the data, but when i am adding the RangeStart and RangeEnd parameters I am getting the below error

the problem seems to be when i am combing the csv files, Power Query creates a column Content which is Binary

and I get this error when expanding the data

I have tried to change the column type to text, but then I get the below error

Can someone please point me in the right direction as to what I need to change to acheive incremental refresh as the data is big and takes long to refresh and having incremental refresh would be amazing

Regards

Rah

[tharunkumarRTK]

@rahul_ferns 

It seems you are filtering the binary data column using the rangestart and rangeend parameters. This will not work. Its could be difficult to implement incremental refresh for sharepoint source as the query folding does not work. 

One possile workaround that I could think is to split the large file into smaller files and keep all the files into one folder in sharepoint and put the incremental refresh filter on file created date column or file modified date column and then in the next step expand the data.

If the post helps please give a thumbs up

If it solves your issue, please accept it as the solution to help the other members find it more quickly.

Tharun

[rahul_ferns]

@tharunkumarRTK 

The files are located in a SharePoint folder, as soon as I add the the parameters I get the error and I am unable to add the filter to the date column

Regards

Rah

[tharunkumarRTK]

rangestart and rangeend parameters contain datetime values and you cannot use them as fiters on a binary column.