Abstract
We present ZAEBUC-Spoken, a multilingual multidialectal Arabic-English speech corpus. The corpus comprises twelve hours of Zoom meetings involving multiple speakers role-playing a work situation where Students brainstorm ideas for a certain topic and then discuss it with an Interlocutor. The meetings cover different topics and are divided into phases with different language setups. The corpus presents a challenging set for automatic speech recognition (ASR), including two languages (Arabic and English) with Arabic spoken in multiple variants (Modern Standard Arabic, Gulf Arabic, and Egyptian Arabic) and English used with various accents. Adding to the complexity of the corpus, there is also code-switching between these languages and dialects. As part of our work, we take inspiration from established sets of transcription guidelines to present a set of guidelines handling issues of conversational speech, code-switching and orthography of both languages. We further enrich the corpus with two layers of annotations; (1) dialectness level annotation for the portion of the corpus where mixing occurs between different variants of Arabic, and (2) automatic morphological annotations, including tokenization, lemmatization, and part-of-speech tagging.
Abstract (translated)
我们提出了ZAEBUC-Spoken，一个多语言多方言的阿拉伯-英语会话语料库。这个语料库包括十二个小时的Zoom会议，其中多人扮演特定主题下的工作场景，学生为该主题脑筋急转弯并随后与交流者讨论。会议涵盖了不同的主题，并分为不同的语言设置阶段。这个语料库为自动语音识别（ASR）带来了具有挑战性的数据集，包括两种语言（阿拉伯语和英语）的多种变体（现代标准阿拉伯语、海湾阿拉伯语和埃及阿拉伯语）以及各种口音的英语。此外，码间切换在这份语料库中也很普遍。 为了进一步简化这个语料库，我们受到了已有的转录指南的启发，提供了一份处理两种语言 conversational speech、code-switching 和 orthography问题的指南。我们还通过添加两个注释层来丰富这个语料库：（1）对于语料库中混杂使用不同阿拉伯语变体的地方，进行了方言级别注释；（2）包括词标、词性标注和句法标注的自动语素标注。
URL
https://arxiv.org/abs/2403.18182
