Encoding Frequency Information in Lexicalized Grammars
Abstract
We address the issue of how to associate frequency information with lexicalized grammar formalisms, using Lexicalized Tree Adjoining Grammar as a representative framework. We consider systematically a number of alternative probabilistic frameworks, evaluating their adequacy from both a theoretical and empirical perspective using data from existing large treebanks. We also propose three orthogonal approaches for backing off probability estimates to cope with the large number of parameters involved.
- Publication:
-
arXiv e-prints
- Pub Date:
- August 1997
- DOI:
- 10.48550/arXiv.cmp-lg/9708012
- arXiv:
- arXiv:cmp-lg/9708012
- Bibcode:
- 1997cmp.lg....8012C
- Keywords:
-
- Computer Science - Computation and Language
- E-Print:
- 10 pages, uses fullname.sty