Hybrid methods for POS guessing of Chinese unknown words

Xiaofei Lu

doi:10.3115/1628960.1628962

Hybrid methods for POS guessing of Chinese unknown words

Xiaofei Lu

Applied Linguistics

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

5 Scopus citations

Abstract

This paper describes a hybrid model that combines a rule-based model with two statistical models for the task of POS guessing of Chinese unknown words. The rule-based model is sensitive to the type, length, and internal structure of unknown words, and the two statistical models utilize contextual information and the likelihood for a character to appear in a particular position of words of a particular length and POS category. By combining models that use different sources of information, the hybrid model achieves a precision of 89%, a significant improvement over the best result reported in previous studies, which was 69%.

Original language	English (US)
Title of host publication	ACL-05 - 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference
Publisher	Association for Computational Linguistics (ACL)
Pages	1-6
Number of pages	6
ISBN (Print)	1932432515, 9781932432510
DOIs	https://doi.org/10.3115/1628960.1628962
State	Published - 2005
Event	43rd Annual Meeting of the Association for Computational Linguistics, ACL-05 - Ann Arbor, MI, United States Duration: Jun 25 2005 → Jun 30 2005

Publication series

Name	ACL-05 - 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference

Other

Other	43rd Annual Meeting of the Association for Computational Linguistics, ACL-05
Country/Territory	United States
City	Ann Arbor, MI
Period	6/25/05 → 6/30/05

All Science Journal Classification (ASJC) codes

Language and Linguistics
Linguistics and Language

Access to Document

10.3115/1628960.1628962

Cite this

Lu, X. (2005). Hybrid methods for POS guessing of Chinese unknown words. In ACL-05 - 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference (pp. 1-6). (ACL-05 - 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference). Association for Computational Linguistics (ACL). https://doi.org/10.3115/1628960.1628962

@inproceedings{c4b2ede261ba48ffaa29ad5f396a6077,

title = "Hybrid methods for POS guessing of Chinese unknown words",

abstract = "This paper describes a hybrid model that combines a rule-based model with two statistical models for the task of POS guessing of Chinese unknown words. The rule-based model is sensitive to the type, length, and internal structure of unknown words, and the two statistical models utilize contextual information and the likelihood for a character to appear in a particular position of words of a particular length and POS category. By combining models that use different sources of information, the hybrid model achieves a precision of 89%, a significant improvement over the best result reported in previous studies, which was 69%.",

author = "Xiaofei Lu",

year = "2005",

doi = "10.3115/1628960.1628962",

language = "English (US)",

isbn = "1932432515",

series = "ACL-05 - 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference",

publisher = "Association for Computational Linguistics (ACL)",

pages = "1--6",

booktitle = "ACL-05 - 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference",

note = "43rd Annual Meeting of the Association for Computational Linguistics, ACL-05 ; Conference date: 25-06-2005 Through 30-06-2005",

}

Lu, X 2005, Hybrid methods for POS guessing of Chinese unknown words. in ACL-05 - 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. ACL-05 - 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference, Association for Computational Linguistics (ACL), pp. 1-6, 43rd Annual Meeting of the Association for Computational Linguistics, ACL-05, Ann Arbor, MI, United States, 6/25/05. https://doi.org/10.3115/1628960.1628962

Hybrid methods for POS guessing of Chinese unknown words. / Lu, Xiaofei.
ACL-05 - 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. Association for Computational Linguistics (ACL), 2005. p. 1-6 (ACL-05 - 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference).

Research output: Chapter in Book/Report/Conference proceeding › Conference contribution

TY - GEN

T1 - Hybrid methods for POS guessing of Chinese unknown words

AU - Lu, Xiaofei

PY - 2005

Y1 - 2005

N2 - This paper describes a hybrid model that combines a rule-based model with two statistical models for the task of POS guessing of Chinese unknown words. The rule-based model is sensitive to the type, length, and internal structure of unknown words, and the two statistical models utilize contextual information and the likelihood for a character to appear in a particular position of words of a particular length and POS category. By combining models that use different sources of information, the hybrid model achieves a precision of 89%, a significant improvement over the best result reported in previous studies, which was 69%.

AB - This paper describes a hybrid model that combines a rule-based model with two statistical models for the task of POS guessing of Chinese unknown words. The rule-based model is sensitive to the type, length, and internal structure of unknown words, and the two statistical models utilize contextual information and the likelihood for a character to appear in a particular position of words of a particular length and POS category. By combining models that use different sources of information, the hybrid model achieves a precision of 89%, a significant improvement over the best result reported in previous studies, which was 69%.

UR - http://www.scopus.com/inward/record.url?scp=84859912482&partnerID=8YFLogxK

UR - http://www.scopus.com/inward/citedby.url?scp=84859912482&partnerID=8YFLogxK

U2 - 10.3115/1628960.1628962

DO - 10.3115/1628960.1628962

M3 - Conference contribution

AN - SCOPUS:84859912482

SN - 1932432515

SN - 9781932432510

T3 - ACL-05 - 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference

SP - 1

EP - 6

BT - ACL-05 - 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference

PB - Association for Computational Linguistics (ACL)

T2 - 43rd Annual Meeting of the Association for Computational Linguistics, ACL-05

Y2 - 25 June 2005 through 30 June 2005

ER -

Lu X. Hybrid methods for POS guessing of Chinese unknown words. In ACL-05 - 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference. Association for Computational Linguistics (ACL). 2005. p. 1-6. (ACL-05 - 43rd Annual Meeting of the Association for Computational Linguistics, Proceedings of the Conference). doi: 10.3115/1628960.1628962

Hybrid methods for POS guessing of Chinese unknown words

Abstract

Publication series

Other

All Science Journal Classification (ASJC) codes

Access to Document

Other files and links

Fingerprint

Cite this