Abstract
The availability of prosodic information from speech signals is useful in a wide range of applications. However, deriving this information from speech signals can be a laborious task involving manual intervention. Therefore, the current work focuses on developing a tool that can provide prosodic annotations corresponding to a given speech signal, particularly for Indian languages. The proposed Segmentation with Intensity, Tones and Break Indices (SIToBI) tool provides time-aligned phoneme, syllable, and word transcriptions, syllable-level pitch contour annotations, break indices, and syllable-level relative intensity indices. The tool focuses more on syllable-level annotations since Indian languages are syllable-timed. Indians, regardless of the language they speak, may exhibit influences from other languages. As a result, other languages spoken in India may also exhibit syllable-timed characteristics. The accuracy of the annotations derived from the tool is analyzed by comparing them against manual annotations and the tool is observed to perform well. While the current work focuses on three languages, namely, Tamil, Hindi, and Indian English, the tool can easily be extended to other Indian languages and possibly other syllable-timed languages as well.
Abstract (translated)
从语音信号中提取韵律信息在各种应用场景中有用,然而,从这些信号中推导出这类信息可能是一项需要大量人工干预的繁重任务。因此,当前的工作重点是开发一种工具,用于为给定的语音信号提供韵律标注,特别是针对印度语言。所提出的强度、声调和停顿索引分段(Segmentation with Intensity, Tones and Break Indices,简称SIToBI)工具提供了与时间对齐的音素、音节和单词转录,音节级别的语调轮廓标注,停顿指数以及音节级别的相对强度指数。 该工具有针对性地提供更多的音节级别注释,因为印度语言通常是音节计时的。无论讲何种语言,印度人都可能受到其他语言的影响,因此在印度使用的其他语言也可能表现出音节计时的特点。通过将工具生成的标注与手动标注进行比较来分析其准确性,并且发现该工具表现良好。 虽然当前的工作重点是三种语言,即泰米尔语、印地语和印度英语,但该工具也可以轻松扩展到其他印度语言及其他音节计时的语言中使用。
URL
https://arxiv.org/abs/2502.09661