Towards a robust frequency-domain analysis: Spectral Rényi divergence revisited

This paper studies a specific category of statistical divergences for spectral densities of time series: the spectral $\alpha$-Rényi divergences, which includes the Itakura--Saito divergence as a subset. While the spectral $\alpha$-Rényi divergence has been acknowledged in past works, its statistical attributes have not been thoroughly investigated. The aim of this paper is to highlight these properties. We reveal the connection between the spectral $\alpha$-Rényi divergence and the $\gamma$-divergence in robust statistics, and a variational representation of spectral $\alpha$-Rényi divergence. Inspired by these results suggesting ``robustness'' of spectral $\alpha$-Rényi divergence, we show that the minimum spectral Rényi divergence estimate has a stable optimization path with respect to outliers in the frequency domain, unlike the minimum Itakura-Saito divergence estimator, and thus it delivers more stable estimate, reducing the need for intricate pre-processing.