Forum Discussion
Filter apply in Query editor
Hi All,
I need to import the CSV file of 25 GB for the last 2 years' data.
The data is very huge so I have applied the filter for the last 6 months to data in query editor to reduce the size.
But Even if applying the filter in Quer editor after Applying the changes, why the data load up to 25 gigs on Power BI desktop?
Thanks,
Hi Anonymous ,
Sorry, does 25 gigs mean 25 GB? If so, because it is designed this way. If it is the import mode, the data imported into Power BI will not be reduced in size due to your filtering.
If you want to reduce the size of the dataset, please try to load data into SQL Server, and then use advanced option to filter data when importing. Or use Direct Query connection when connecting to SQL Server.
Best Regards,
Stephen Tao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
2 Replies
Hey Anonymous ,
this happens because csv and other file-based data sources do not query folding, for this reason, it's necessary to first load everything before the data can be filtered.
Regards,
Tom
Hi Anonymous ,
Sorry, does 25 gigs mean 25 GB? If so, because it is designed this way. If it is the import mode, the data imported into Power BI will not be reduced in size due to your filtering.
If you want to reduce the size of the dataset, please try to load data into SQL Server, and then use advanced option to filter data when importing. Or use Direct Query connection when connecting to SQL Server.
Best Regards,
Stephen Tao
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
