use NLP to identify similar phrase/words : <p>In our raw data, we know there're dirty data. For example, City name may be "Kunming", "Kun-Ming" or "kunming(city)", they all refer to a city named "Kun Ming". If we have a standard dictionary of city names, how can we clean our data using NLP. I'm thinking about building a multiple-label (city name) classification model. It will predict any words as "kun,ming" to a label refer to "Kun Ming".</p>

<p>Or maybe define a similarity function to take a raw city name as input and compare to every standard city names in the dictionary and return the highest similarity score one. That is f("Kunming") will compare "kunming" to "city a","city b"... and return "kunming".</p>

<p>I'm only using city name as an example. We also have other column that have longer string value that can implement bag of words.</p>
