Abstract—This paper has proposed the use Latent Semantic Indexing (LSI) to extract semantic information to make the best use of the existing knowledge contained in training sets: Semantic Characterisation (SemC). SemC uses LSI to capture the implicit semantic structure in documents by directly applying category labels imposed by experts to make semantic structure explicit. The training set filtered by SemC is tested on a supervised automated text categorization system using Support Vector Machine as classifier. Category by category analysis has shown the ability to bring out the semantic characteristics of the datasets. Even with a reduced training set, SemC is able to overcome the generalisation problem due to its ability to reduce noise within individual categories. Our empirical results also demonstrated that SemC managed to improve categorisation results of heavily overlapping categories. Empirical results also showed that SemC is applicable to a various supervised classifiers.
Index Terms—Automated text categorisation, dataset, latent semantic indexing.
The authors are with the Faculty of Computer Science and Information Technology, Universiti Malaysia Sarawak, 94300 Kota Samarahan,Malaysia (e-mail: firstname.lastname@example.org, email@example.com,firstname.lastname@example.org).
Cite: Tan Ping Ping, Narayanan Kulathuramaiyer, and Azlina Ahmadi Julaihi, "Semantic Characterisation: Knowledge Discovery for Training Set," International Journal of Innovation, Management and Technology vol. 4, no. 1, pp. 59-61, 2013.