Language Models Understand Us, Poorly
Abstract
Some claim language models understand us. Others won't hear it. To clarify, I investigate three views of human language understanding: as-mapping, as-reliability and as-representation. I argue that while behavioral reliability is necessary for understanding, internal representations are sufficient; they climb the right hill. I review state-of-the-art language and multi-modal models: they are pragmatically challenged by under-specification of form. I question the Scaling Paradigm: limits on resources may prohibit scaled-up models from approaching understanding. Last, I describe how as-representation advances a science of understanding. We need work which probes model internals, adds more of human language, and measures what models can learn.
- Publication:
-
arXiv e-prints
- Pub Date:
- October 2022
- DOI:
- 10.48550/arXiv.2210.10684
- arXiv:
- arXiv:2210.10684
- Bibcode:
- 2022arXiv221010684M
- Keywords:
-
- Computer Science - Computation and Language;
- Computer Science - Artificial Intelligence;
- I.2.7
- E-Print:
- 5 pages, 1 figure, to be published in Findings of EMNLP 2022