Skip to main content
cancel
Showing results for 
Search instead for 
Did you mean: 

Earn a 50% discount on the DP-600 certification exam by completing the Fabric 30 Days to Learn It challenge.

Reply
HamidBee
Impactful Individual
Impactful Individual

Power BI Python Script Out of Memory Error When Truncating DataFrame

Hello,

 

I'm encountering an out of memory error when trying to run a Python script within Power BI to manipulate a dataset. I aim to truncate a dataset to only the first 5 rows using a Python script step in the Power Query Editor. Here's the script I am using:

 

import pandas as pd

# 'dataset' holds the input data for this script
# Keep only the first 5 rows
dataset = dataset.head(5)

 

 

 

However, when I execute the script, I receive the following error message:

 
DataSource.Error: ADO.NET: Python script error.
pandas.errors.ParserError: Error tokenizing data. C error: out of memory
Details:
DataSourceKind=Python
DataSourcePath=Python
Message=Python script error.
ErrorCode=-2147467259
ExceptionType=Microsoft.PowerBI.Scripting.Python.Exceptions.PythonScriptRuntimeException

 

The dataset is not particularly large, so it's puzzling why this memory issue arises. I've tried to ensure that my system has enough available memory and even filtered the dataset in Power Query before handing it off to Python, but to no avail.

 

Has anyone faced a similar issue or can offer insights into what might be going wrong? Any advice on how to troubleshoot this error would be greatly appreciated.

 

Thank you in advance for your help!

1 REPLY 1
v-nuoc-msft
Community Support
Community Support

Hi @HamidBee 

 

I found something related to your problem and you can try the methods mentioned in it.

 

Error tokenizing data. C error: out of memory pandas python, large file csv - Stack Overflow

 

Regards,

Nono Chen

If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.

Helpful resources

Announcements
RTI Forums Carousel3

New forum boards available in Real-Time Intelligence.

Ask questions in Eventhouse and KQL, Eventstream, and Reflex.

MayPowerBICarousel

Power BI Monthly Update - May 2024

Check out the May 2024 Power BI update to learn about new features.

LearnSurvey

Fabric certifications survey

Certification feedback opportunity for the community.