Paper Reading AI Learner

Mixat: A Data Set of Bilingual Emirati-English Speech

2024-05-04 06:06:34
Maryam Al Ali, Hanan Aldarmaki

Abstract

This paper introduces Mixat: a dataset of Emirati speech code-mixed with English. Mixat was developed to address the shortcomings of current speech recognition resources when applied to Emirati speech, and in particular, to bilignual Emirati speakers who often mix and switch between their local dialect and English. The data set consists of 15 hours of speech derived from two public podcasts featuring native Emirati speakers, one of which is in the form of conversations between the host and a guest. Therefore, the collection contains examples of Emirati-English code-switching in both formal and natural conversational contexts. In this paper, we describe the process of data collection and annotation, and describe some of the features and statistics of the resulting data set. In addition, we evaluate the performance of pre-trained Arabic and multi-lingual ASR systems on our dataset, demonstrating the shortcomings of existing models on this low-resource dialectal Arabic, and the additional challenge of recognizing code-switching in ASR. The dataset will be made publicly available for research use.

Abstract (translated)

本文介绍了Mixat数据集:这是用英语对阿联酋语音进行混合的数据集。Mixat数据集是为了解决应用到阿联酋语音的现有语音识别资源的不足而开发的,尤其是针对双语阿联酋 speakers,他们经常混合和切换本地方言和英语。数据集包括来自两个公共播客的非母语阿联酋人士的15小时语音,其中一个是以主持人与嘉宾之间的对话形式呈现的。因此,数据集中包含了阿联酋-英语代码转换在正式和非正式会话背景中的例子。在本文中,我们描述了数据收集和注释的过程,并描述了数据集中的某些特征和统计数字。此外,我们还评估了预训练的阿拉伯语和多语言 ASR系统在我们的数据集上的性能,证明了对于这种低资源的中东阿拉伯语,现有模型的不足以及识别代码转换在 ASR 中的挑战。该数据集将公开发布,供研究使用。

URL

https://arxiv.org/abs/2405.02578

PDF

https://arxiv.org/pdf/2405.02578.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot