Identifying, indexing, and ranking chemical formulae and chemical names in digital documents

Bingjun Sun, Prasenjit Mitra, C. Lee Giles, Karl T. Mueller

Research output: Contribution to journalArticlepeer-review

12 Scopus citations

Abstract

End-users utilize chemical search engines to search for chemical formulae and chemical names. Chemical search engines identify and index chemical formulae and chemical names appearing in text documents to support efficient search and retrieval in the future. Identifying chemical formulae and chemical names in text automatically has been a hard problem that has met with varying degrees of success in the past. We propose algorithms for chemical formula and chemical name tagging using Conditional Random Fields (CRFs) and Support Vector Machines (SVMs) that achieve higher accuracy than existing (published) methods. After chemical entities have been identified in text documents, they must be indexed. In order to support userprovided search queries that require a partial match between the chemical name segment used as a keyword or a partial chemical formula, all possible (or a significant number of) subformulae of formulae that appear in any document and all possible subterms (e.g., "methyl") of chemical names (e.g., "methylethyl ketone") must be indexed. Indexing all possible subformulae and subterms results in an exponential increase in the storage and memory requirements as well as the time taken to process the indices. We propose techniques to prune the indices significantly without reducing the quality of the returned results significantly. Finally, we propose multiple query semantics to allow users to pose different types of partial search queries for chemical entities. We demonstrate empirically that our search engines improve the relevance of the returned results for search queries involving chemical entities.

Original languageEnglish (US)
Article number12
JournalACM Transactions on Information Systems
Volume29
Issue number2
DOIs
StatePublished - Apr 2011

All Science Journal Classification (ASJC) codes

  • Information Systems
  • Business, Management and Accounting(all)
  • Computer Science Applications

Fingerprint

Dive into the research topics of 'Identifying, indexing, and ranking chemical formulae and chemical names in digital documents'. Together they form a unique fingerprint.

Cite this