Abstract
Large Vision Language models have seen huge application in several sports use-cases recently. Most of these works have been targeted towards a limited subset of popular sports like soccer, cricket, basketball etc; focusing on generative tasks like visual question answering, highlight generation. This work analyzes the applicability of the modern video foundation models (both encoder and decoder) for a very niche but hugely popular dance sports - breakdance. Our results show that Video Encoder models continue to outperform state-of-the-art Video Language Models for prediction tasks. We provide insights on how to choose the encoder model and provide a thorough analysis into the workings of a finetuned decoder model for breakdance video classification.
Abstract (translated)
近期，大型视觉语言模型在多个体育应用场景中得到了广泛应用。这些研究大多集中在一些流行运动（如足球、板球和篮球）的特定子集上，并侧重于诸如视觉问答和精彩片段生成等生成任务。本项工作分析了现代视频基础模型（包括编码器和解码器）在一项非常小众但极其受欢迎的舞蹈体育项目——霹雳舞中的适用性。我们的研究结果表明，视频编码器模型在预测任务中仍优于最先进的视频语言模型。我们还提供了如何选择编码器模型的见解，并对经过微调的解码器模型在霹雳舞视频分类方面的运作进行了深入分析。
URL
https://arxiv.org/abs/2510.20287
