Forum Discussion
How to import large csv file in powerBI
Hi Techinmay,
Here's a robust, production-grade approach for handling very large CSV imports. For truly massive datasets, skip the Push API and use Fabric's native ingestion:
# Upload split CSVs to Fabric Lakehouse via Azure Data Lake / OneLake
$storageUrl = "https://onelake.dfs.fabric.microsoft.com"
$workspace = "your-workspace-name"
$lakehouse = "your-lakehouse-name"
Get-ChildItem "C:\Data\Split\batch_*.csv" | ForEach-Object {
$destination = "$storageUrl/$workspace/$lakehouse.Lakehouse/Files/imports/$($_.Name)"
Invoke-RestMethod -Uri $destination -Method PUT `
-Headers @{ Authorization = "Bearer $token" } `
-InFile $_.FullName
Write-Host "Uploaded: $($_.Name)"
}
Then trigger a Fabric Notebook or Data Pipeline to load from the Files section into a Delta table.
Remember that :
Push API row limit: 10,000 rows per call, 1M rows/hour per dataset
Fabric OneLake: No practical file size limit
Dataflow Gen2: Best for transformation + load at scale
Always use UTF-8 encoding to avoid character corruption across splits
Hope this helps! Don't forget to mark as solution and thumbs up, that's motivate me to keep helping 🙂