Score Design for Multi-Criteria Incentivization
Abstract
We present a framework for designing scores to summarize performance metrics. Our design has two multi-criteria objectives: (1) improving on scores should improve all performance metrics, and (2) achieving pareto-optimal scores should achieve pareto-optimal metrics. We formulate our design to minimize the dimensionality of scores while satisfying the objectives. We give algorithms to design scores, which are provably minimal under mild assumptions on the structure of performance metrics. This framework draws motivation from real-world practices in hospital rating systems, where misaligned scores and performance metrics lead to unintended consequences.
- Publication:
-
arXiv e-prints
- Pub Date:
- October 2024
- DOI:
- 10.48550/arXiv.2410.06290
- arXiv:
- arXiv:2410.06290
- Bibcode:
- 2024arXiv241006290K
- Keywords:
-
- Computer Science - Computers and Society;
- Computer Science - Computational Geometry;
- Computer Science - Machine Learning
- E-Print:
- A condensed version of this paper appeared at Foundations of Responsible Computing (FORC) 2024