Is There a "Language of Music-Video Clips" ? A Qualitative and Quantitative Study - Télécom Paris Access content directly
Conference Papers Year : 2021

Is There a "Language of Music-Video Clips" ? A Qualitative and Quantitative Study

Abstract

Recommending automatically a video given a music or a music given a video has become an important asset for the audiovisual industry-with user-generated or professional content. While both music and video have specific temporal organizations, most current works do not consider those and only focus on globally recommending a media. As a first step toward the improvement of these recommendation systems, we study in this paper the relationship between music and video temporal organization. We do this for the case of official music videos, with a quantitative and a qualitative approach. Our assumption is that the movement in the music are correlated to the ones in the video. To validate this, we first interview a set of internationally recognized music video experts. We then perform a largescale analysis of official music-video clips (which we manually annotated into video genres) using MIR description tools (downbeats and functional segments estimation) and Computer Vision tools (shot detection). Our study confirms that a "language of music-video clips" exists; i.e. editors favor the co-occurrence of music and video events using strategies such as anticipation. It also highlights that the amount of co-occurrence depends on the music and video genres.
Fichier principal
Vignette du fichier
camera_ready.pdf (1.04 Mo) Télécharger le fichier
Origin Files produced by the author(s)

Dates and versions

hal-03330800 , version 1 (01-09-2021)

Identifiers

  • HAL Id : hal-03330800 , version 1

Cite

Laure Prétet, Gaël Richard, Geoffroy Peeters. Is There a "Language of Music-Video Clips" ? A Qualitative and Quantitative Study. ISMIR, Nov 2021, Virtual Event, France. ⟨hal-03330800⟩
240 View
245 Download

Share

Gmail Mastodon Facebook X LinkedIn More