Forum Discussion

schau's avatar
schau
Regular Visitor
8 years ago
Solved

Transforming CSV file from SharePoint folder

Hi all,

 

I have a SharePoint folder which holds a number of large csv files. I want to set up a query which opens all the files in the folder and puts the data into a single view. I was wondering if this is possible and how I can achieve this, noting that:

 

  • The number of CSV files in the SharePoint folder will increase over time
  • All the CSV files will have several header rows (First 8 rows of each CSV file need to be removed)

I've been looking around the community and I've seen solutions when using a folder as the data source, however I haven't been able to find anything for SharePoint folders. Could somebody please point me in the right direction? 

  • schau's avatar
    schau
    8 years ago

    Hey Lydia,

     

    Thanks for the reply. The headers in the CSV are not exactly identical as it also contains some additional metadata. I think because of this, it's not able to automatically detect that they are headers and end up leaving them in the dataset as well.

     

    I've figured it out however. After combining the files, I needed to remove the headers from the pre-generated transfomration sample file to get rid of all the header information.

     

    Thanks

3 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable
    8 years ago

    schau,

    Do all the CSV files have same data columns and same column name? If so, enter the root URL of your SharePoint site in the SharePoint Folder connector, then just click the double arrows in Query Editor to combine the CSV files and put data into a single view. And once you add new CSV files in the SharePoint folder, just click "Refresh Preview" button in Query Editor to bring new data.



    Regards,
    Lydia

    • schau's avatar
      schau
      Regular Visitor
      8 years ago

      Hey Lydia,

       

      Thanks for the reply. The headers in the CSV are not exactly identical as it also contains some additional metadata. I think because of this, it's not able to automatically detect that they are headers and end up leaving them in the dataset as well.

       

      I've figured it out however. After combining the files, I needed to remove the headers from the pre-generated transfomration sample file to get rid of all the header information.

       

      Thanks

      • Anonymous's avatar
        Anonymous
        Not applicable
        8 years ago

        schau,

        Glad to hear that the issue is solved. Please mark appropriate replies as solutions, that way, other community members would easily find the solution when they get same issues.

        Regards,
        Lydia