CRYSTAL: Inducing a Conceptual Dictionary
Abstract
One of the central knowledge sources of an information extraction system is a dictionary of linguistic patterns that can be used to identify the conceptual content of a text. This paper describes CRYSTAL, a system which automatically induces a dictionary of "concept-node definitions" sufficient to identify relevant information from a training corpus. Each of these concept-node definitions is generalized as far as possible without producing errors, so that a minimum number of dictionary entries cover the positive training instances. Because it tests the accuracy of each proposed definition, CRYSTAL can often surpass human intuitions in creating reliable extraction rules.
- Publication:
-
arXiv e-prints
- Pub Date:
- May 1995
- DOI:
- 10.48550/arXiv.cmp-lg/9505020
- arXiv:
- arXiv:cmp-lg/9505020
- Bibcode:
- 1995cmp.lg....5020S
- Keywords:
-
- Computer Science - Computation and Language
- E-Print:
- 6 pages, Postscript, IJCAI-95 http://ciir.cs.umass.edu/info/psfiles/tepubs/tepubs.html