Adapting Pitch-Based Self Supervised Learning Models for Tempo Estimation

Antonin Gagneré (1, 2) , Slim Essid (1, 2) , Geoffroy Peeters (1, 2)

1 S2A - Signal, Statistique et Apprentissage
2 IDS - Département Images, Données, Signal

Tempo estimation is the task of estimating the periodicity of the dominant rhythm pulse of a music audio signal. It has therefore a close relationship with dominant pitch estimation. Recently, both tasks have been addressed in a ssl fashion so as to leverage unlabelled data for training. In this work, we study the applicability of two successful pitch-based ssl models, SPICE and PESTO, for the purpose of tempo estimation. Both successfully exploit Siamese networks with a pitch-shifting view generation between the two branches. To apply these models for tempo estimation, we represent the audio signal by the cqt of its onset-strength-function and adapt their view generation using time-stretching (instead of pitch shifting), which is efficiently implemented by shifting the cqt. In a large experiment, we show that simply adapting PESTO in this way yields superior results than the previous ssl approach to tempo estimation for most datasets used in the reference benchmark. Further, since PESTO is light-weight, requiring only a few training data, we study a new learning scheme where the downstream datasets are processed directly in a ssl fashion (without access to labels) showing that this is an interesting alternative further improving the performance for some datasets.

Keywords: Tempo estimation; Self-supervised-learning; Training; Adaptation models; Zero-shot learning; Estimation; Training data; Self-supervised learning; Transforms

Domains: Artificial Intelligence [cs.AI]

Antonin Gagneré, Slim Essid, Geoffroy Peeters. Adapting Pitch-Based Self Supervised Learning Models for Tempo Estimation. ICASSP 2024 - 2024 IEEE International Conference on Acoustics, Speech and Signal Processing (ICASSP), Apr 2024, Seoul, South Korea. pp.956-960, ⟨10.1109/ICASSP48485.2024.10447129⟩. ⟨hal-04544157⟩