Remove punctuations in pandas

Question

code: df['review'].head()
        index         review
output: 0      These flannel wipes are OK, but in my opinion

I want to remove punctuations from the column of the dataframe and create a new column.

code: import string 
      def remove_punctuations(text):
          return text.translate(None,string.punctuation)

      df["new_column"] = df['review'].apply(remove_punctuations)

Error:
  return text.translate(None,string.punctuation)
  AttributeError: 'float' object has no attribute 'translate'

I am using python 2.7. Any suggestions would be helpful.

Solution 1

Using Pandas str.replace and regex:

df["new_column"] = df['review'].str.replace('[^\w\s]','')

Solution 2

You can build a regex using the string module's punctuation list:

df['review'].str.replace('[{}]'.format(string.punctuation), '')

Solution 3

I solved the problem by looping through the string.punctuation

def remove_punctuations(text):
    for punctuation in string.punctuation:
        text = text.replace(punctuation, '')
    return text

You can call the function the same way you did and It should work.

df["new_column"] = df['review'].apply(remove_punctuations)

Comments

[Joe T. Boka]

You want to have a new column with the same string values but without the punctuation? Why?

[data_person]

@JoeR i am practising sentiment analysis on the data

[bernando_vialli]

@ Bob Haffner, thank you for this but how would I preserve spaces that previously existed?

[Roy]

Hi @bob-haffner, I want to remove punctuation (only dot .) only after the letter c and p. How can I do that?

[The Singularity]

Use import string