Regret Bounds for Risk-Sensitive Reinforcement Learning
Abstract
In safety-critical applications of reinforcement learning such as healthcare and robotics, it is often desirable to optimize risk-sensitive objectives that account for tail outcomes rather than expected reward. We prove the first regret bounds for reinforcement learning under a general class of risk-sensitive objectives including the popular CVaR objective. Our theory is based on a novel characterization of the CVaR objective as well as a novel optimistic MDP construction.
- Publication:
-
arXiv e-prints
- Pub Date:
- October 2022
- DOI:
- 10.48550/arXiv.2210.05650
- arXiv:
- arXiv:2210.05650
- Bibcode:
- 2022arXiv221005650B
- Keywords:
-
- Computer Science - Machine Learning