The development of telecom network and Internet provides effective ways for communication. As an important way in communication, Short Messaging Service (SMS) via both telecom network and Internet has played an increasing important role in daily life. However, it usually suffers from spam SMS that causes misunderstanding and cheat. The highly varying content, network environment make the identification of spam message difficult. Although the previous methods to some extent can filter the spam messages, it usually fails to capture the semantic information because it simply relies on keywords. Thus, its accuracy is not satisfied enough.