Paper Reading AI Learner

Enhancing Mathematics Learning for Hard-of-Hearing Students Through Real-Time Palestinian Sign Language Recognition: A New Dataset

2025-05-16 19:14:25
Fidaa khandaqji, Huthaifa I. Ashqar, Abdelrahem Atawnih

Abstract

The study aims to enhance mathematics education accessibility for hard-of-hearing students by developing an accurate Palestinian sign language PSL recognition system using advanced artificial intelligence techniques. Due to the scarcity of digital resources for PSL, a custom dataset comprising 41 mathematical gesture classes was created, and recorded by PSL experts to ensure linguistic accuracy and domain specificity. To leverage state-of-the-art-computer vision techniques, a Vision Transformer ViTModel was fine-tuned for gesture classification. The model achieved an accuracy of 97.59%, demonstrating its effectiveness in recognizing mathematical signs with high precision and reliability. This study highlights the role of deep learning in developing intelligent educational tools that bridge the learning gap for hard-of-hearing students by providing AI-driven interactive solutions to enhance mathematical comprehension. This work represents a significant step toward innovative and inclusive frosting digital integration in specialized learning environments. The dataset is hosted on Hugging Face at this https URL.

Abstract (translated)

该研究旨在通过使用先进的人工智能技术开发一个准确的巴勒斯坦手语(PSL)识别系统,提高听力受损学生的数学教育可及性。由于缺乏数字资源,创建了一个包含41个数学手势类别的定制数据集,并由PSL专家录制以确保语言准确性与领域专属性。为了利用最先进的计算机视觉技术,对Vision Transformer (ViT) 模型进行了微调用于手势分类。该模型实现了97.59%的准确率,证明了其在识别数学符号时具有高精度和可靠性。本研究强调深度学习在开发智能教育工具中的作用,这些工具通过提供AI驱动的互动解决方案来缩小听力受损学生的学业差距,从而增强他们的数学理解能力。这项工作标志着向创新和包容性数字化整合专业学习环境迈出的重要一步。数据集托管于Hugging Face平台上的此链接:[请参见原文]。 注意:原始文本中的URL无法直接复制粘贴到翻译结果中,请访问原始文档获取具体链接地址。

URL

https://arxiv.org/abs/2505.17055

PDF

https://arxiv.org/pdf/2505.17055.pdf


Tags
3D Action Action_Localization Action_Recognition Activity Adversarial Agent Attention Autonomous Bert Boundary_Detection Caption Chat Classification CNN Compressive_Sensing Contour Contrastive_Learning Deep_Learning Denoising Detection Dialog Diffusion Drone Dynamic_Memory_Network Edge_Detection Embedding Embodied Emotion Enhancement Face Face_Detection Face_Recognition Facial_Landmark Few-Shot Gait_Recognition GAN Gaze_Estimation Gesture Gradient_Descent Handwriting Human_Parsing Image_Caption Image_Classification Image_Compression Image_Enhancement Image_Generation Image_Matting Image_Retrieval Inference Inpainting Intelligent_Chip Knowledge Knowledge_Graph Language_Model LLM Matching Medical Memory_Networks Multi_Modal Multi_Task NAS NMT Object_Detection Object_Tracking OCR Ontology Optical_Character Optical_Flow Optimization Person_Re-identification Point_Cloud Portrait_Generation Pose Pose_Estimation Prediction QA Quantitative Quantitative_Finance Quantization Re-identification Recognition Recommendation Reconstruction Regularization Reinforcement_Learning Relation Relation_Extraction Represenation Represenation_Learning Restoration Review RNN Robot Salient Scene_Classification Scene_Generation Scene_Parsing Scene_Text Segmentation Self-Supervised Semantic_Instance_Segmentation Semantic_Segmentation Semi_Global Semi_Supervised Sence_graph Sentiment Sentiment_Classification Sketch SLAM Sparse Speech Speech_Recognition Style_Transfer Summarization Super_Resolution Surveillance Survey Text_Classification Text_Generation Time_Series Tracking Transfer_Learning Transformer Unsupervised Video_Caption Video_Classification Video_Indexing Video_Prediction Video_Retrieval Visual_Relation VQA Weakly_Supervised Zero-Shot