nltk wordpunct_tokenize vs word_tokenize : <p>Does anyone know the difference between <code>nltk</code>'s <code>wordpunct_tokenize</code> and <code>word_tokenize</code>? I'm using <code>nltk=3.2.4</code> and there's nothing on the doc string of <code>wordpunct_tokenize</code> that explains the difference. I couldn't find this info either in the documentation of <code>nltk</code> (perhaps I didn't search in the right place!). I would have expected that first one would get rid of punctuation tokens or the like, but it doesn't. </p>

<p><a href="https://i.stack.imgur.com/yCbSq.png" rel="noreferrer"><img src="https://i.stack.imgur.com/yCbSq.png" alt="enter image description here"></a></p>
