Forum Discussion

Laiq_Rahman's avatar
Laiq_Rahman
Helper I
3 years ago
Solved

Incremental Refresh on csv files from sharepoint folder

Hi,

I am trying to do incremental refresh based on file name (.csv files) from sharepoint. It's a sharepoint folder where we have all the files in this format "monthly_cost_hourly_2021-01, monthly_cost_hourly_2021-02 etc.,". I want to retain last two years of .csv files but refresh runs only for current month. Do you've anything handy based on my requirement?  

Regards,

Laiq

4 Replies

  • HI KNP 

     

    It works perfect. Thank you so much. Any chance if we can do the same in dataflow. It's asking datetime field should exist while configuring incremental load.

     

    Regards,

    Laiq

    • KNP's avatar
      KNP
      Super User

      You'll need to convert your date field to a datetime, or duplicate it and convert to datetime so you have a field to configure the IR policy on.

       

  • Incremental refresh doesn't work for sharepoint or CSV. Think about switching to another data source that supports incremental refresh.