Event enhanced Passive Non-line-of-sight imaging for moving objects with Physical embedding
Abstract
Passive Non-line-of-sight (NLOS) imaging has shown promising applications in imaging occluded objects around corners. However, this inverse problem is highly ill-posed and results in poor reconstruction with traditional physical retrieval methods, particularly in moving target imaging. With the development of neural networks, data-driven methods have greatly improved accuracy, however, heavy reliance on data volume has put great pressure on data collection and dataset fabrication. We propose a physical embedded passive NLOS imaging prototype with event-based vision (EPNP), which induces an event camera for feature extraction of dynamic diffusion spot and leverages simulation dataset to pre-train the physical embedded model before fine-tuning with limited real-shot data. The proposed PNPE is verified by simulation and real-world experiments, and the comparisons of data paradigms also validate the superiority of event-based vision in passive NLOS imaging for moving targets.
- Publication:
-
arXiv e-prints
- Pub Date:
- April 2024
- DOI:
- 10.48550/arXiv.2404.05977
- arXiv:
- arXiv:2404.05977
- Bibcode:
- 2024arXiv240405977W
- Keywords:
-
- Physics - Optics
- E-Print:
- This work has been submitted to the IEEE for possible publication. Copyright may be transferred without notice, after which this version may no longer be accessible