Abstract
In this paper, we propose a novel approach for air drawing that uses image processing techniques to draw on the screen by moving fingers in the air. This approach benefits a wide range of applications such as sign language, in-air drawing, and 'writing' in the air as a new way of input. The approach starts with preparing ROI (Region of Interest) background images by taking a running average in initial camera frames and later subtracting it from the live camera frames to get a binary mask image. We calculate the pointer's position as the top of the contour on the binary image. When drawing a circle on the canvas in that position, it simulates the drawing. Furthermore, we combine the pre-trained Tesseract model for OCR purposes. To address the false contours, we perform hand detection based on the haar cascade before performing the background subtraction. In an experimental setup, we achieved a latency of only 100ms in air drawing. The code used to this research are available in GitHub as this https URL
Abstract (translated)
在这篇论文中，我们提出了一种新颖的空中绘图方法，该方法利用图像处理技术，在空中移动手指即可在屏幕上作画。这种方法适用于广泛的应用场景，如手语、空中绘画和作为输入新方式的“空中书写”。我们的方法首先通过初始摄像帧中的运行平均值准备ROI（感兴趣区域）背景图像，并随后从实时摄像帧中减去该背景以获得二进制掩模图像。我们计算指针的位置为二值图上轮廓的顶部。当在该位置画布上的相应位置绘制圆形时，它模拟了绘画的过程。此外，我们将预训练的Tesseract模型结合用于OCR（光学字符识别）目的。为了应对误判轮廓的问题，在执行背景减法之前进行了基于Haar级联的手部检测。在一个实验设置中，我们的空中绘图技术实现了仅100毫秒的延迟。 本研究使用的代码可在GitHub上的以下链接获取：[请在此处插入实际URL]
URL
https://arxiv.org/abs/2503.01497
