Forum Discussion

campelliann's avatar
campelliann
Post Patron
5 years ago
Solved

Csv files vs SQL server performance

Hi, 

 

So we have a company timesheet from which we can extract Csv files with the time, costs and revenue from the projects.

 

My managers now want a centralized report with many of the companies projects and are "afraid" the dashboard will become "slow". 

The primary source will be the csv files, but is there any gain in performance, building a database in SQL by uploading the csv files into de server?

 

Thank you.

  • Hi campelliann 

     

    If your data is all imported into the dataset, I think the performance has little difference when you viewing the report because queries are sent to the dataset which already holds the data rather than to the data sources. The performance difference will probably occur when you refresh the dataset. When refreshing data, queries are sent to data sources, so different data sources will have different connection and query durations, which leads to different refreshing time. 

     

    Regards,
    Community Support Team _ Jing
    If this post helps, please Accept it as the solution to help other members find it.

3 Replies

  • Anonymous's avatar
    Anonymous
    Not applicable

    No idea about performance but a database in SQL is much more reliable than CSV's. To be able to say anything about performance in both cases.... well, you have to test. Nothing else will do.

  • aj1973's avatar
    aj1973
    Community Champion

    Hi campelliann 

    Like Anonymous said SQL is better, so it is also better to insert your data into SQL DB from the get going rather than into CSV files and then upload them to SQL. 

  • v-jingzhang's avatar
    v-jingzhang
    Community Support

    Hi campelliann 

     

    If your data is all imported into the dataset, I think the performance has little difference when you viewing the report because queries are sent to the dataset which already holds the data rather than to the data sources. The performance difference will probably occur when you refresh the dataset. When refreshing data, queries are sent to data sources, so different data sources will have different connection and query durations, which leads to different refreshing time. 

     

    Regards,
    Community Support Team _ Jing
    If this post helps, please Accept it as the solution to help other members find it.