Who is GPT-3? An Exploration of Personality, Values and Demographics
Abstract
Language models such as GPT-3 have caused a furore in the research community. Some studies found that GPT-3 has some creative abilities and makes mistakes that are on par with human behaviour. This paper answers a related question: Who is GPT-3? We administered two validated measurement tools to GPT-3 to assess its personality, the values it holds and its self-reported demographics. Our results show that GPT-3 scores similarly to human samples in terms of personality and - when provided with a model response memory - in terms of the values it holds. We provide the first evidence of psychological assessment of the GPT-3 model and thereby add to our understanding of this language model. We close with suggestions for future research that moves social science closer to language models and vice versa.
- Publication:
-
arXiv e-prints
- Pub Date:
- September 2022
- DOI:
- 10.48550/arXiv.2209.14338
- arXiv:
- arXiv:2209.14338
- Bibcode:
- 2022arXiv220914338M
- Keywords:
-
- Computer Science - Computation and Language
- E-Print:
- EMNLP 2022 NLP+CSS workshop