Forum Discussion
Helper IPython script error
Hi ganeshnr073 ,
It seems like your code is working with the SentimentIntensityAnalyzer from the nltk library to analyze the sentiment of messages in a dataset. If the code was working fine until a few days ago, it's possible that there might be some new data in the dataset causing the issue.
To handle potential null values or empty strings in the 'Message' column, you can modify the lambda function in the apply() method like this:
dataset['polairty scores'] = dataset['Message'].apply(lambda x: sia.polarity_scores(x)['compound'] if x is not None and x.strip() != '' else None)This will check if the value is not null and not an empty string before applying the sentiment analysis. If the value is null or an empty string, it will assign None to the 'polairty scores' column for that row.
Best Regards,
Jianbo Li
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
Super Userganeshnr073 , share some code. the issue is with some text type variable or column
ganeshnr073Hi amitchandak
It working fine until few days back. I had filtered out the balnks columns as well.
Here is the code :
#load in our dependencies
import pandas as pd
from nltk.sentiment.vader import SentimentIntensityAnalyzer#load in the sentiment analyzer
sia=SentimentIntensityAnalyzer()#apply the analyzer over each comment
dataset['polairty scores'] =dataset['Message'].apply(lambda x: sia.polarity_scores(x)['compound'])
v-jianboli-msftCommunity Support
Hi ganeshnr073 ,
It seems like your code is working with the SentimentIntensityAnalyzer from the nltk library to analyze the sentiment of messages in a dataset. If the code was working fine until a few days ago, it's possible that there might be some new data in the dataset causing the issue.
To handle potential null values or empty strings in the 'Message' column, you can modify the lambda function in the apply() method like this:
dataset['polairty scores'] = dataset['Message'].apply(lambda x: sia.polarity_scores(x)['compound'] if x is not None and x.strip() != '' else None)This will check if the value is not null and not an empty string before applying the sentiment analysis. If the value is null or an empty string, it will assign None to the 'polairty scores' column for that row.
Best Regards,
Jianbo Li
If this post helps, then please consider Accept it as the solution to help the other members find it more quickly.
- ganeshnr073
Thank you for the help !!