Category Discrimination Based Feature Selection Algorithm in Chinese Text Classification.
Saved in:
| Title: | Category Discrimination Based Feature Selection Algorithm in Chinese Text Classification. |
|---|---|
| Authors: | JUNKAI YI1 yijk@mail.buct.edu.cn, GUANG YANG1 jensen-yg@163.com, JING WAN1 wanj@mail.buct.edu.cn |
| Source: | Journal of Information Science & Engineering. Sep2016, Vol. 32 Issue 5, p1145-1159. 15p. |
| Subjects: | Computer software selection, Computational linguistics, Text recognition, Chinese language, Vector processing (Computer science), Computer network resources |
| Abstract: | How to improve the classification precision is a major issue in the field of Chinese text classification. The tf-idf algorithm is a classic and widely-used feature selection algorithm based on VSM. But the traditional tf-idf algorithm neglects the feature term's distribution inside category and among categories, which causes many unreasonable selective results. This paper makes an improvement to the traditional tf-idf algorithm through the introduction of the concept of Category Discrimination. We evaluate our algorithm with experiments, and make comparisons with other algorithms. The experimental results show that the improved tf-idf algorithm consistently has a higher precision and recall compared with the traditional tf-idf algorithm, and is superior to other algorithm as a whole. Therefore, it is a more effective feature selection algorithm in text classification field. [ABSTRACT FROM AUTHOR] |
| Copyright of Journal of Information Science & Engineering is the property of Institute of Information Science, Academia Sinica and its content may not be copied or emailed to multiple sites without the copyright holder's express written permission. Additionally, content may not be used with any artificial intelligence tools or machine learning technologies. However, users may print, download, or email articles for individual use. This abstract may be abridged. No warranty is given about the accuracy of the copy. Users should refer to the original published version of the material for the full abstract. (Copyright applies to all Abstracts.) | |
| Database: | Engineering Source |
Be the first to leave a comment!
