DJ-MVP : An Automatic Music Video Producer

Jianyu Fan, William Li, Jim Bizzocchi, Justine Bizzocchi, Philippe Pasquier


A music video (MV) is a videotaped performance of a recorded popular song, usually accompanied by dancing and visual images. In this paper, we outline the design of a generative music video system, which automatically generates an audio-video mashup for a given target audio track. The system performs segmentation for the given target song based on beat detection. Next, according to audio similarity analysis and color heuristic selection methods, we obtain generated video segments. Then, these video segments are truncated to match the length of audio segments and are concatenated as the final music video. An evaluation of our system has shown that users are receptive to this novel presentation of music videos and are interested in future developments.

Type : Conference Paper

Publication : International Conference on Advances in Computer Entertainment Technology (ACE), 2016