A Synthetic Prediction Market for Estimating Confidence in Published Work
Abstract
Explainably estimating confidence in published scholarly work offers opportunity for faster and more robust scientific progress. We develop a synthetic prediction market to assess the credibility of published claims in the social and behavioral sciences literature. We demonstrate our system and detail our findings using a collection of known replication projects. We suggest that this work lays the foundation for a research agenda that creatively uses AI for peer review.
- Publication:
-
arXiv e-prints
- Pub Date:
- December 2021
- DOI:
- 10.48550/arXiv.2201.06924
- arXiv:
- arXiv:2201.06924
- Bibcode:
- 2022arXiv220106924R
- Keywords:
-
- Computer Science - Computers and Society;
- Computer Science - Artificial Intelligence;
- Computer Science - Information Retrieval;
- Computer Science - Machine Learning;
- Computer Science - Multiagent Systems