Self-improving object detection via disagreement reconciliation
Abstract
Object detectors often experience a drop in performance when new environmental conditions are insufficiently represented in the training data. This paper studies how to automatically fine-tune a pre-existing object detector while exploring and acquiring images in a new environment without relying on human intervention, i.e., in a self-supervised fashion. In our setting, an agent initially explores the environment using a pre-trained off-the-shelf detector to locate objects and associate pseudo-labels. By assuming that pseudo-labels for the same object must be consistent across different views, we devise a novel mechanism for producing refined predictions from the consensus among observations. Our approach improves the off-the-shelf object detector by 2.66% in terms of mAP and outperforms the current state of the art without relying on ground-truth annotations.
- Publication:
-
arXiv e-prints
- Pub Date:
- February 2023
- DOI:
- 10.48550/arXiv.2302.10624
- arXiv:
- arXiv:2302.10624
- Bibcode:
- 2023arXiv230210624S
- Keywords:
-
- Computer Science - Computer Vision and Pattern Recognition
- E-Print:
- This article is a conference paper related to arXiv:2302.03566 and is currently under review