Forum Discussion

sashan's avatar
sashan
Regular Visitor
9 years ago

r script code page to Unicode

I am pulling twitter data for my Machine Learning experiment
After I get the data from my search, I want to turn it to a dataframe like this:

 

tweets <- searchTwitter("Bicester Village", n=1000)

df <- do.call("rbind", lapply(tweets, as.data.frame))

 

Twitter data arrives as list of S4 elements. I can successfully carry out experiment in my R Studio and get the results I want.

I then want to see if the data will display in sources, but I see this error:

Error

Details: "Unable to translate bytes [ED][A0] at index 1 from specified code page to Unicode."

I have tried endlesly to convert to UTF-8 (which is not a problem in R Studio), but no luck

2 Replies

    • Anonymous's avatar
      Anonymous
      Not applicable
      9 years ago

      Hi sashan

       

      I too got the same issue.

      I have solved this as below

       

      library(twitteR)
      library(stringi)
      tweets <- searchTwitter("Bicester Village", n=100,lang="en")
      df <- twListToDF(tweets)
      df$text <- stri_encode(df_tweets$text, "", "UTF-8")

       

      But strange thing is it works fine in RStudio but not in power bi query sometimes