Semi_Supervised
-
MD-IQA: Learning Multi-scale Distributed Image Quality Assessment with Semi Supervised Learning for Low Dose CT
2023-11-14 09:33:33Tao Song, Ruizhi Hou, Lisong Dai, Lei XiangAbstract
Image quality assessment (IQA) plays a critical role in optimizing radiation dose and developing novel medical imaging techniques in computed tomography (CT). Traditional IQA methods relying on hand-crafted features have limitations in summarizing the subjective perceptual experience of image quality. Recent deep learning-based approaches have demonstrated strong modeling capabilities and potential for medical IQA, but challenges remain regarding model generalization and perceptual accuracy. In this work, we propose a multi-scale distributions regression approach to predict quality scores by constraining the output distribution, thereby improving model generalization. Furthermore, we design a dual-branch alignment network to enhance feature extraction capabilities. Additionally, semi-supervised learning is introduced by utilizing pseudo-labels for unlabeled data to guide model training. Extensive qualitative experiments demonstrate the effectiveness of our proposed method for advancing the state-of-the-art in deep learning-based medical IQA. Code is available at: this https URL.
Abstract (translated)
图像质量评估（IQA）在优化辐射剂量和开发计算机断层扫描（CT）中的新医学成像技术方面起着关键作用。传统IQA方法依赖于手工定制特征，在总结图像质量的主观感知经验方面存在局限性。最近基于深度学习的IQA方法显示出强大的建模能力和医学IQA的潜在可能性，但模型的泛化能力和感知准确性仍然存在挑战。在本文中，我们提出了一种多尺度分布回归方法，通过约束输出分布来预测质量分数，从而提高模型的泛化能力。此外，我们还设计了一个双分支对齐网络来增强特征提取能力。此外，通过利用未标记数据的伪标签进行半监督学习，进一步提高了模型的训练效果。大量实验证明，我们提出的IQA方法在推动基于深度学习的医学IQA领域取得了最先进的成果。代码可在此链接下载：https://this URL。
URL
https://arxiv.org/abs/2311.08024
PDF
-
BanglaBait: Semi-Supervised Adversarial Approach for Clickbait Detection on Bangla Clickbait Dataset
2023-11-10 17:38:46Md. Motahar Mahtab, Monirul Haque, Mehedi Hasan, Farig SadequeAbstract
Intentionally luring readers to click on a particular content by exploiting their curiosity defines a title as clickbait. Although several studies focused on detecting clickbait titles in English articles, low resource language like Bangla has not been given adequate attention. To tackle clickbait titles in Bangla, we have constructed the first Bangla clickbait detection dataset containing 15,056 labeled news articles and 65,406 unlabelled news articles extracted from clickbait dense news sites. Each article has been labeled by three expert linguists and includes an article's title, body, and other metadata. By incorporating labeled and unlabelled data, we finetune a pretrained Bangla transformer model in an adversarial fashion using Semi Supervised Generative Adversarial Networks (SS GANs). The proposed model acts as a good baseline for this dataset, outperforming traditional neural network models (LSTM, GRU, CNN) and linguistic feature based models. We expect that this dataset and the detailed analysis and comparison of these clickbait detection models will provide a fundamental basis for future research into detecting clickbait titles in Bengali articles. We have released the corresponding code and dataset.
Abstract (translated)
有意识地吸引读者点击特定内容，通过利用他们的好奇心定义标题为点击标题。尽管有几项研究关注于在英语文章中检测点击标题，但像孟加拉语这样的低资源语言尚未得到足够的关注。为了解决孟加拉语中的点击标题问题，我们构建了包含15,056个有标签的新闻文章和65,406个无标签的新闻文章的第一个孟加拉语点击标题检测数据集。每篇文章都由三位专家级语言学家标注，包括文章标题、正文和其他元数据。通过结合有标签和无标签数据，我们以对抗的方式微调了预训练的孟加拉语Transformer模型。该模型作为这个数据集的基准，超过了传统神经网络模型（LSTM，GRU，CNN）和基于语言特征的模型。我们预计，这个数据集以及这些点击标题检测模型的详细分析和比较将为未来研究提供基础，以在孟加拉语文章中检测点击标题。我们已经发布了相应的代码和数据集。
URL
https://arxiv.org/abs/2311.06204
PDF
-
SegMatch: A semi-supervised learning method for surgical instrument segmentation
2023-08-09 21:30:18Meng Wei, Charlie Budd, Luis C. Garcia-Peraza-Herrera, Reuben Dorent, Miaojing Shi, Tom VercauterenAbstract
Surgical instrument segmentation is recognised as a key enabler to provide advanced surgical assistance and improve computer assisted interventions. In this work, we propose SegMatch, a semi supervised learning method to reduce the need for expensive annotation for laparoscopic and robotic surgical images. SegMatch builds on FixMatch, a widespread semi supervised classification pipeline combining consistency regularization and pseudo labelling, and adapts it for the purpose of segmentation. In our proposed SegMatch, the unlabelled images are weakly augmented and fed into the segmentation model to generate a pseudo-label to enforce the unsupervised loss against the output of the model for the adversarial augmented image on the pixels with a high confidence score. Our adaptation for segmentation tasks includes carefully considering the equivariance and invariance properties of the augmentation functions we rely on. To increase the relevance of our augmentations, we depart from using only handcrafted augmentations and introduce a trainable adversarial augmentation strategy. Our algorithm was evaluated on the MICCAI Instrument Segmentation Challenge datasets Robust-MIS 2019 and EndoVis 2017. Our results demonstrate that adding unlabelled data for training purposes allows us to surpass the performance of fully supervised approaches which are limited by the availability of training data in these challenges. SegMatch also outperforms a range of state-of-the-art semi-supervised learning semantic segmentation models in different labelled to unlabelled data ratios.
Abstract (translated)
surgical instrument segmentation 被认为是提供高级手术辅助和提高计算机辅助干预的关键工具。在这项工作中,我们提出了 segMatch 半监督学习方法,以降低对Laparoscopic 和机器人手术图像的昂贵标记的依赖性。SegMatch 建立在 fixMatch 普遍使用的半监督分类管道,结合一致性 Regularization 和伪标签,并适应于分割任务。在我们提出的 segMatch 中,未标记的图像进行弱增强,并输入到分割模型,生成伪标签,以强制模型输出对具有高信心值像素的无监督损失与模型的输出。我们对分割任务的调整包括仔细考虑我们依赖的增强函数的等温性和不变性性质。为了增加我们的增强函数的相关性,我们离开了仅使用手工增强和引入训练可增强的对抗增强策略。我们的方法在 MICCAI 设备分割挑战数据集 Robust-MIS 2019 和EndoVis 2017 中进行评估。我们的结果表明,为训练目的添加未标记数据可以使我们超过这些挑战中完全监督方法的性能限制。此外, segMatch 在不同类型的标记数据比例下表现出比当前最先进的半监督学习语义分割模型更好的性能。
URL
https://arxiv.org/abs/2308.05232
PDF
-
Monocular 3D Object Detection with LiDAR Guided Semi Supervised Active Learning
2023-07-17 11:55:27Aral Hekimoglu, Michael Schmidt, Alvaro Marcos-RamiroAbstract
We propose a novel semi-supervised active learning (SSAL) framework for monocular 3D object detection with LiDAR guidance (MonoLiG), which leverages all modalities of collected data during model development. We utilize LiDAR to guide the data selection and training of monocular 3D detectors without introducing any overhead in the inference phase. During training, we leverage the LiDAR teacher, monocular student cross-modal framework from semi-supervised learning to distill information from unlabeled data as pseudo-labels. To handle the differences in sensor characteristics, we propose a data noise-based weighting mechanism to reduce the effect of propagating noise from LiDAR modality to monocular. For selecting which samples to label to improve the model performance, we propose a sensor consistency-based selection score that is also coherent with the training objective. Extensive experimental results on KITTI and Waymo datasets verify the effectiveness of our proposed framework. In particular, our selection strategy consistently outperforms state-of-the-art active learning baselines, yielding up to 17% better saving rate in labeling costs. Our training strategy attains the top place in KITTI 3D and birds-eye-view (BEV) monocular object detection official benchmarks by improving the BEV Average Precision (AP) by 2.02.
Abstract (translated)
我们提出了一种新的半监督主动学习(SSAL)框架,以单眼3D物体检测为例,利用LiDAR guidance(单眼LiG),在模型开发过程中利用所有数据模式。我们利用LiDAR指导选择和训练单眼3D探测器,在推理阶段没有引入任何额外的负担。在训练过程中,我们利用半监督学习的LiDAR教师和单眼学生跨modal框架,从半监督学习中提取信息,将其作为伪标签进行舍入。为了处理传感器特性的差异,我们提出了一种数据噪声加权机制,以减少LiDAR模式向单眼模式的传播噪声的影响。为了选择哪些样本进行标注以改善模型性能,我们提出了一种传感器一致性选择得分,也与训练目标相一致。在KITTI和Waymo数据集上的广泛实验结果验证了我们提出的框架的有效性。特别是,我们的选择策略 consistently outperforms state-of-the-art主动学习基准线,在标签成本方面提高了17%的节省率。我们的训练策略通过提高KITTI3D和 birds-eye-view(BEV)单眼物体检测官方基准线的AP值,达到了最高排名。
URL
https://arxiv.org/abs/2307.08415
PDF
-
Semi Supervised Meta Learning for Spatiotemporal Learning
2023-07-09 04:09:58Faraz Waseem, Pratyush MuthukumarAbstract
We approached the goal of applying meta-learning to self-supervised masked autoencoders for spatiotemporal learning in three steps. Broadly, we seek to understand the impact of applying meta-learning to existing state-of-the-art representation learning architectures. Thus, we test spatiotemporal learning through: a meta-learning architecture only, a representation learning architecture only, and an architecture applying representation learning alongside a meta learning architecture. We utilize the Memory Augmented Neural Network (MANN) architecture to apply meta-learning to our framework. Specifically, we first experiment with applying a pre-trained MAE and fine-tuning on our small-scale spatiotemporal dataset for video reconstruction tasks. Next, we experiment with training an MAE encoder and applying a classification head for action classification tasks. Finally, we experiment with applying a pre-trained MAE and fine-tune with MANN backbone for action classification tasks.
Abstract (translated)
我们采取了三个步骤来接近将元学习应用于自监督掩码生成器以时间空间学习的目标。总的来说,我们旨在理解将元学习应用于现有先进的表示学习架构的影响。因此,我们只有通过元学习架构、表示学习架构和元学习架构一起使用的架构来测试时间空间学习。我们利用增强记忆神经网络(MANN)架构将元学习应用于我们的框架。具体来说,我们首先尝试应用预训练的MAE并对我们的小型时间空间数据集进行微调,以进行视频重建任务。然后,我们尝试训练MAE编码器和应用分类头,以进行动作分类任务。最后,我们尝试应用预训练的MAE并调整ManN的骨架以进行动作分类任务。
URL
https://arxiv.org/abs/2308.01916
PDF
-
ABAW : Facial Expression Recognition in the wild
2023-03-17 06:01:04Darshan Gera, Badveeti Naveen Siva Kumar, Bobbili Veerendra Raj Kumar, S BalasubramanianAbstract
The fifth Affective Behavior Analysis in-the-wild (ABAW) competition has multiple challenges such as Valence-Arousal Estimation Challenge, Expression Classification Challenge, Action Unit Detection Challenge, Emotional Reaction Intensity Estimation Challenge. In this paper we have dealt only expression classification challenge using multiple approaches such as fully supervised, semi-supervised and noisy label approach. Our approach using noise aware model has performed better than baseline model by 10.46% and semi supervised model has performed better than baseline model by 9.38% and the fully supervised model has performed better than the baseline by 9.34%
Abstract (translated)
这篇文献讨论了第五项野生情感行为分析挑战(ABAW)竞赛,其中包括多个挑战,例如情感强度估计挑战、表达分类挑战、动作单元检测挑战和情绪反应强度估计挑战。在本文中,我们使用多个方法,如完全监督、半监督和噪声标签方法,来处理表达分类挑战。我们使用噪声意识到模型的方法表现得更好,比基准模型提高了10.46%。半监督模型表现得更好,比基准模型提高了9.38%。完全监督模型表现得更好,比基准提高了9.34%。
URL
https://arxiv.org/abs/2303.09785
PDF
-
Cross Modal Distillation for Flood Extent Mapping
2023-02-16 09:57:08Shubhika Garg, Ben Feinstein, Shahar Timnat, Vishal Batchu, Gideon Dror, Adi Gerzi Rosenthal, Varun GulshanAbstract
The increasing intensity and frequency of floods is one of the many consequences of our changing climate. In this work, we explore ML techniques that improve the flood detection module of an operational early flood warning system. Our method exploits an unlabelled dataset of paired multi-spectral and Synthetic Aperture Radar (SAR) imagery to reduce the labeling requirements of a purely supervised learning method. Prior works have used unlabelled data by creating weak labels out of them. However, from our experiments we noticed that such a model still ends up learning the label mistakes in those weak labels. Motivated by knowledge distillation and semi supervised learning, we explore the use of a teacher to train a student with the help of a small hand labelled dataset and a large unlabelled dataset. Unlike the conventional self distillation setup, we propose a cross modal distillation framework that transfers supervision from a teacher trained on richer modality (multi-spectral images) to a student model trained on SAR imagery. The trained models are then tested on the Sen1Floods11 dataset. Our model outperforms the Sen1Floods11 baseline model trained on the weak labeled SAR imagery by an absolute margin of 6.53% Intersection-over-Union (IoU) on the test split.
Abstract (translated)
洪水的强度和频率的增加是我们气候变化的许多后果之一。在这个研究中,我们探讨了机器学习技术,以提高 operational early flood warning system 中的洪水检测模块。我们利用一个未标记的配对多光谱和合成孔径雷达图像的未命名数据集,以降低纯粹的监督学习方法的标记要求。以前的工作已经使用未标记数据,从它们中创建弱标签。然而,从我们的实验中我们发现,这样的模型仍然最终学习这些弱标签的标记错误。基于知识蒸馏和半监督学习的动机,我们探讨了使用一名教师帮助训练学生的方法,使用一个小手标注的数据集和一个大型未标注的数据集。与传统的自蒸馏setup不同,我们提出了一种跨modal蒸馏框架,将监督从训练丰富的modality(多光谱图像)转移到训练SAR图像的学生模型中。训练模型后,在Sen1Floods11数据集上进行了测试。我们的模型在弱标签SAR图像上的标记错误训练 Sen1Floods11 基线模型的相对误差6.53%的IoU上表现出色。
URL
https://arxiv.org/abs/2302.08180
PDF
-
Don't fear the unlabelled: safe deep semi-supervised learning via simple debiaising
2022-03-14 21:42:21Hugo Schmutz, Olivier Humbert, Pierre-Alexandre MatteiAbstract
Semi supervised learning (SSL) provides an effective means of leveraging unlabelled data to improve a model's performance. Even though the domain has received a considerable amount of attention in the past years, most methods present the common drawback of being unsafe. By safeness we mean the quality of not degrading a fully supervised model when including unlabelled data. Our starting point is to notice that the estimate of the risk that most discriminative SSL methods minimise is biased, even asymptotically. This bias makes these techniques untrustable without a proper validation set, but we propose a simple way of removing the bias. Our debiasing approach is straightforward to implement, and applicable to most deep SSL methods. We provide simple theoretical guarantees on the safeness of these modified methods, without having to rely on the strong assumptions on the data distribution that SSL theory usually requires. We evaluate debiased versions of different existing SSL methods and show that debiasing can compete with classic deep SSL techniques in various classic settings and even performs well when traditional SSL fails.
Abstract (translated)
URL
https://arxiv.org/abs/2203.07512
PDF
-
Self Semi Supervised Neural Architecture Search for Semantic Segmentation
2022-01-29 19:49:44Loïc Pauletto, Massih-Reza Amini, Nicolas WincklerAbstract
In this paper, we propose a Neural Architecture Search strategy based on self supervision and semi-supervised learning for the task of semantic segmentation. Our approach builds an optimized neural network (NN) model for this task by jointly solving a jigsaw pretext task discovered with self-supervised learning over unlabeled training data, and, exploiting the structure of the unlabeled data with semi-supervised learning. The search of the architecture of the NN model is performed by dynamic routing using a gradient descent algorithm. Experiments on the Cityscapes and PASCAL VOC 2012 datasets demonstrate that the discovered neural network is more efficient than a state-of-the-art hand-crafted NN model with four times less floating operations.
Abstract (translated)
URL
https://arxiv.org/abs/2201.12646
PDF
-
Organ localisation using supervised and semi supervised approaches combining reinforcement learning with imitation learning
2021-12-06 14:04:38Sankaran Iyer, Alan Blair, Laughlin Dawes, Daniel Moses, Christopher White, Arcot SowmyaAbstract
Computer aided diagnostics often requires analysis of a region of interest (ROI) within a radiology scan, and the ROI may be an organ or a suborgan. Although deep learning algorithms have the ability to outperform other methods, they rely on the availability of a large amount of annotated data. Motivated by the need to address this limitation, an approach to localisation and detection of multiple organs based on supervised and semi-supervised learning is presented here. It draws upon previous work by the authors on localising the thoracic and lumbar spine region in CT images. The method generates six bounding boxes of organs of interest, which are then fused to a single bounding box. The results of experiments on localisation of the Spleen, Left and Right Kidneys in CT Images using supervised and semi supervised learning (SSL) demonstrate the ability to address data limitations with a much smaller data set and fewer annotations, compared to other state-of-the-art methods. The SSL performance was evaluated using three different mixes of labelled and unlabelled data (i.e.30:70,35:65,40:60) for each of lumbar spine, spleen left and right kidneys respectively. The results indicate that SSL provides a workable alternative especially in medical imaging where it is difficult to obtain annotated data.
Abstract (translated)
URL
https://arxiv.org/abs/2112.03276
PDF
-
GI-NNet & RGI-NNet: Development of Robotic Grasp Pose Models, Trainable with Large as well as Limited Labelled Training Datasets, under supervised and semi supervised paradigms
2021-07-15 16:55:49Priya Shukla, Nilotpal Pramanik, Deepesh Mehta, G.C. NandiAbstract
Our way of grasping objects is challenging for efficient, intelligent and optimal grasp by COBOTs. To streamline the process, here we use deep learning techniques to help robots learn to generate and execute appropriate grasps quickly. We developed a Generative Inception Neural Network (GI-NNet) model, capable of generating antipodal robotic grasps on seen as well as unseen objects. It is trained on Cornell Grasping Dataset (CGD) and attained 98.87% grasp pose accuracy for detecting both regular and irregular shaped objects from RGB-Depth (RGB-D) images while requiring only one third of the network trainable parameters as compared to the existing approaches. However, to attain this level of performance the model requires the entire 90% of the available labelled data of CGD keeping only 10% labelled data for testing which makes it vulnerable to poor generalization. Furthermore, getting sufficient and quality labelled dataset is becoming increasingly difficult keeping in pace with the requirement of gigantic networks. To address these issues, we attach our model as a decoder with a semi-supervised learning based architecture known as Vector Quantized Variational Auto Encoder (VQVAE), which works efficiently when trained both with the available labelled and unlabelled data. The proposed model, which we name as Representation based GI-NNet (RGI-NNet), has been trained with various splits of label data on CGD with as minimum as 10% labelled dataset together with latent embedding generated from VQVAE up to 50% labelled data with latent embedding obtained from VQVAE. The performance level, in terms of grasp pose accuracy of RGI-NNet, varies between 92.13% to 95.6% which is far better than several existing models trained with only labelled dataset. For the performance verification of both GI-NNet and RGI-NNet models, we use Anukul (Baxter) hardware cobot.
Abstract (translated)
URL
https://arxiv.org/abs/2107.07452
PDF
-
Learning from Pixel-Level Label Noise: A New Perspective for Semi-Supervised Semantic Segmentation
2021-03-26 03:23:21Rumeng Yi, Yaping Huang, Qingji Guan, Mengyang Pu, Runsheng ZhangAbstract
This paper addresses semi-supervised semantic segmentation by exploiting a small set of images with pixel-level annotations (strong supervisions) and a large set of images with only image-level annotations (weak supervisions). Most existing approaches aim to generate accurate pixel-level labels from weak supervisions. However, we observe that those generated labels still inevitably contain noisy labels. Motivated by this observation, we present a novel perspective and formulate this task as a problem of learning with pixel-level label noise. Existing noisy label methods, nevertheless, mainly aim at image-level tasks, which can not capture the relationship between neighboring labels in one image. Therefore, we propose a graph based label noise detection and correction framework to deal with pixel-level noisy labels. In particular, for the generated pixel-level noisy labels from weak supervisions by Class Activation Map (CAM), we train a clean segmentation model with strong supervisions to detect the clean labels from these noisy labels according to the cross-entropy loss. Then, we adopt a superpixel-based graph to represent the relations of spatial adjacency and semantic similarity between pixels in one image. Finally we correct the noisy labels using a Graph Attention Network (GAT) supervised by detected clean labels. We comprehensively conduct experiments on PASCAL VOC 2012, PASCAL-Context and MS-COCO datasets. The experimental results show that our proposed semi supervised method achieves the state-of-the-art performances and even outperforms the fully-supervised models on PASCAL VOC 2012 and MS-COCO datasets in some cases.
Abstract (translated)
URL
https://arxiv.org/abs/2103.14242
PDF
-
Semi Supervised Learning For Few-shot Audio Classification By Episodic Triplet Mining
2021-02-16 10:55:31Swapnil Bhosale, Rupayan Chakraborty, Sunil Kumar KopparapuAbstract
Few-shot learning aims to generalize unseen classes that appear during testing but are unavailable during training. Prototypical networks incorporate few-shot metric learning, by constructing a class prototype in the form of a mean vector of the embedded support points within a class. The performance of prototypical networks in extreme few-shot scenarios (like one-shot) degrades drastically, mainly due to the desuetude of variations within the clusters while constructing prototypes. In this paper, we propose to replace the typical prototypical loss function with an Episodic Triplet Mining (ETM) technique. The conventional triplet selection leads to overfitting, because of all possible combinations being used during training. We incorporate episodic training for mining the semi hard positive and the semi hard negative triplets to overcome the overfitting. We also propose an adaptation to make use of unlabeled training samples for better modeling. Experimenting on two different audio processing tasks, namely speaker recognition and audio event detection; show improved performances and hence the efficacy of ETM over the prototypical loss function and other meta-learning frameworks. Further, we show improved performances when unlabeled training samples are used.
Abstract (translated)
URL
https://arxiv.org/abs/2102.08074
PDF
-
Semi Supervised Deep Quick Instance Detection and Segmentation
2021-01-16 08:50:36Ashish Kumar, L. BeheraAbstract
In this paper, we present a semi supervised deep quick learning framework for instance detection and pixel-wise semantic segmentation of images in a dense clutter of items. The framework can quickly and incrementally learn novel items in an online manner by real-time data acquisition and generating corresponding ground truths on its own. To learn various combinations of items, it can synthesize cluttered scenes, in real time. The overall approach is based on the tutor-child analogy in which a deep network (tutor) is pretrained for class-agnostic object detection which generates labeled data for another deep network (child). The child utilizes a customized convolutional neural network head for the purpose of quick learning. There are broadly four key components of the proposed framework semi supervised labeling, occlusion aware clutter synthesis, a customized convolutional neural network head, and instance detection. The initial version of this framework was implemented during our participation in Amazon Robotics Challenge (ARC), 2017. Our system was ranked 3rd, 4th and 5th worldwide in pick, stow-pick and stow task respectively. The proposed framework is an improved version over ARC17 where novel features such as instance detection and online learning has been added.
Abstract (translated)
URL
https://arxiv.org/abs/2101.06405
PDF
-
Semi supervised segmentation and graph-based tracking of 3D nuclei in time-lapse microscopy
2020-10-26 05:09:44S. Shailja, Jiaxiang Jiang, B.S. ManjunathAbstract
We propose a novel weakly supervised method to improve the boundary of the 3D segmented nuclei utilizing an over-segmented image. This is motivated by the observation that current state-of-the-art deep learning methods do not result in accurate boundaries when the training data is weakly annotated. Towards this, a 3D U-Net is trained to get the centroid of the nuclei and integrated with a simple linear iterative clustering (SLIC) supervoxel algorithm that provides better adherence to cluster boundaries. To track these segmented nuclei, our algorithm utilizes the relative nuclei location depicting the processes of nuclei division and apoptosis. The proposed algorithmic pipeline achieves better segmentation performance compared to the state-of-the-art method in Cell Tracking Challenge (CTC) 2019 and comparable performance to state-of-the-art methods in IEEE ISBI CTC2020 while utilizing very few pixel-wise annotated data. Detailed experimental results are provided, and the source code is available on GitHub.
Abstract (translated)
URL
https://arxiv.org/abs/2010.13343
PDF
-
An original framework for Wheat Head Detection using Deep, Semi-supervised and Ensemble Learning within Global Wheat Head Detection Dataset
2020-09-24 22:58:40Fares Fourati, Wided Souidene, Rabah AttiaAbstract
In this paper, we propose an original object detection methodology applied to Global Wheat Head Detection (GWHD) Dataset. We have been through two major architectures of object detection which are FasterRCNN and EfficientDet, in order to design a novel and robust wheat head detection model. We emphasize on optimizing the performance of our proposed final architectures. Furthermore, we have been through an extensive exploratory data analysis and adapted best data augmentation techniques to our context. We use semi supervised learning to boost previous supervised models of object detection. Moreover, we put much effort on ensemble to achieve higher performance. Finally we use specific post-processing techniques to optimize our wheat head detection results. Our results have been submitted to solve a research challenge launched on the GWHD Dataset which is led by nine research institutes from seven countries. Our proposed method was ranked within the top 6% in the above mentioned challenge.
Abstract (translated)
URL
https://arxiv.org/abs/2009.11977
PDF
-
Semi-Supervised Fine-Tuning for Deep Learning Models in Remote Sensing Applications
2020-05-30 19:54:32Eftychios Protopapadakis, Anastasios Doulamis, Nikolaos Doulamis, Evangelos MaltezosAbstract
A combinatory approach of two well-known fields: deep learning and semi supervised learning is presented, to tackle the land cover identification problem. The proposed methodology demonstrates the impact on the performance of deep learning models, when SSL approaches are used as performance functions during training. Obtained results, at pixel level segmentation tasks over orthoimages, suggest that SSL enhanced loss functions can be beneficial in models' performance.
Abstract (translated)
URL
https://arxiv.org/abs/2006.00345
PDF
-
ScrabbleGAN: Semi-Supervised Varying Length Handwritten Text Generation
2020-03-23 21:41:19Sharon Fogel (1), Hadar Averbuch-Elor (2), Sarel Cohen, Shai Mazor (1), Roee Litman (1) ((1) Amazon Rekognition Israel, (2) Cornell University)Abstract
Optical character recognition (OCR) systems performance have improved significantly in the deep learning era. This is especially true for handwritten text recognition (HTR), where each author has a unique style, unlike printed text, where the variation is smaller by design. That said, deep learning based HTR is limited, as in every other task, by the number of training examples. Gathering data is a challenging and costly task, and even more so, the labeling task that follows, of which we focus here. One possible approach to reduce the burden of data annotation is semi-supervised learning. Semi supervised methods use, in addition to labeled data, some unlabeled samples to improve performance, compared to fully supervised ones. Consequently, such methods may adapt to unseen images during test time. We present ScrabbleGAN, a semi-supervised approach to synthesize handwritten text images that are versatile both in style and lexicon. ScrabbleGAN relies on a novel generative model which can generate images of words with an arbitrary length. We show how to operate our approach in a semi-supervised manner, enjoying the aforementioned benefits such as performance boost over state of the art supervised HTR. Furthermore, our generator can manipulate the resulting text style. This allows us to change, for instance, whether the text is cursive, or how thin is the pen stroke.
Abstract (translated)
URL
https://arxiv.org/abs/2003.10557
PDF
-
Exploiting semi-supervised training through a dropout regularization in end-to-end speech recognition
2019-08-08 19:21:49Subhadeep Dey, Petr Motlicek, Trung Bui, Franck DernoncourtAbstract
In this paper, we explore various approaches for semi supervised learning in an end to end automatic speech recognition (ASR) framework. The first step in our approach involves training a seed model on the limited amount of labelled data. Additional unlabelled speech data is employed through a data selection mechanism to obtain the best hypothesized output, further used to retrain the seed model. However, uncertainties of the model may not be well captured with a single hypothesis. As opposed to this technique, we apply a dropout mechanism to capture the uncertainty by obtaining multiple hypothesized text transcripts of an speech recording. We assume that the diversity of automatically generated transcripts for an utterance will implicitly increase the reliability of the model. Finally, the data selection process is also applied on these hypothesized transcripts to reduce the uncertainty. Experiments on freely available TEDLIUM corpus and proprietary Adobe's internal dataset show that the proposed approach significantly reduces ASR errors, compared to the baseline model.
Abstract (translated)
URL
https://arxiv.org/abs/1908.05227
PDF
-
Semi Supervised Phrase Localization in a Bidirectional Caption-Image Retrieval Framework
2019-08-08 07:01:26Deepan Das, Noor Mohammed Ghouse, Shashank Verma, Yin LiAbstract
We introduce a novel deep neural network architecture that links visual regions to corresponding textual segments including phrases and words. To accomplish this task, our architecture makes use of the rich semantic information available in a joint embedding space of multi-modal data. From this joint embedding space, we extract the associative localization maps that develop naturally, without explicitly providing supervision during training for the localization task. The joint space is learned using a bidirectional ranking objective that is optimized using a $N$-Pair loss formulation. This training mechanism demonstrates the idea that localization information is learned inherently while optimizing a Bidirectional Retrieval objective. The model's retrieval and localization performance is evaluated on MSCOCO and Flickr30K Entities datasets. This architecture outperforms the state of the art results in the semi-supervised phrase localization setting.
Abstract (translated)
URL
https://arxiv.org/abs/1908.02950
PDF
