How to import large csv to dataset using powershell

Hey Hariharan_R 

When importing a large CSV file into a dataset using PowerShell, it is recommended to avoid loading the entire file into memory at once, as this can impact performance and lead to processing failures with very large datasets.

Instead, use PowerShell cmdlets such as Import-Csv with batch processing logic or stream data in smaller chunks for efficient handling. For exceptionally large CSV files, a better approach is to split the source file before import. In such scenario, it's recommended using SysTools CSV Splitter tool can divide a large CSV into multiple smaller files while maintaining data integrity, column headers, and record structure.

This helps improve processing efficiency, reduces memory consumption, and simplifies large-scale dataset imports in PowerShell environments. You can check it on App Store or Marketplace.

Is this helpful? Give me a thumbs up as an appreciation.

Thanks @leo