Image_Caption

2022-06-27 Lesion-Aware Contrastive Representation Learning for Histopathology Whole Slide Images Analysis Jun Li, Yushan Zheng, Kun Wu, Jun Shi, Fengying Xie, Zhiguo Jiang arXiv_CV arXiv_CV Image_Caption Represenation_Learning Self-Supervised Pose Contrastive_Learning Classification Attention PDF
2022-06-24 Deep embedded clustering algorithm for clustering PACS repositories Teo Manojlović, Matija Milanič, Ivan Štajduhar arXiv_CV arXiv_CV Image_Caption Embedding Unsupervised Action Medical CNN PDF
2022-06-21 Transformer-Based Multi-modal Proposal and Re-Rank for Wikipedia Image-Caption Matching Nicola Messina, Davide Alessandro Coccomini, Andrea Esuli, Fabrizio Falchi arXiv_CV arXiv_CV Image_Caption Transformer Pose Caption Inference Matching PDF
2022-06-21 SemMAE: Semantic-Guided Masking for Learning Masked Autoencoders Gang Li, Heliang Zheng, Daqing Liu, Bing Su, Changwen Zheng arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation Recognition Self-Supervised Relation Attention Language_Model PDF
2022-06-21 KTN: Knowledge Transfer Network for Learning Multi-person 2D-3D Correspondences Xuanhan Wang, Lianli Gao, Yixuan Zhou, Jingkuan Song, Meng Wang arXiv_CV arXiv_CV Image_Caption Segmentation 3D Pose_Estimation Knowledge Knowledge_Graph Pose Detection CNN PDF
2022-06-20 DALL-E for Detection: Language-driven Context Image Synthesis for Object Detection Yunhao Ge, Jiashu Xu, Brian Nlong Zhao, Laurent Itti, Vibhav Vineet arXiv_CV arXiv_CV Image_Caption Recognition Zero-Shot Pose Detection Object_Detection Caption PDF
2022-06-19 A Self-Guided Framework for Radiology Report Generation Jun Li, Shibo Li, Ying Hu, Huiren Tao arXiv_CV arXiv_CV Image_Caption Unsupervised Knowledge Pose Deep_Learning Medical Caption PDF
2022-06-19 What is Where by Looking: Weakly-Supervised Open-World Phrase-Grounding without Text Inputs Tal Shaharabany, Yoad Tewel, Lior Wolf arXiv_CV arXiv_CV Image_Caption Segmentation Weakly_Supervised Caption Inference Matching PDF
2022-06-17 Intra-Instance VICReg: Bag of Self-Supervised Image Patch Embedding Yubei Chen, Adrien Bardes, Zengyi Li, Yann LeCun arXiv_CV arXiv_CV Image_Caption Embedding Knowledge Self-Supervised Pose PDF
2022-06-16 Beyond Supervised vs. Unsupervised: Representative Benchmarking and Analysis of Image Representation Learning Matthew Gwilliam, Abhinav Shrivastava arXiv_CV arXiv_CV Image_Caption Embedding Unsupervised Represenation_Learning Pose Contrastive_Learning Classification Prediction PDF
2022-06-16 Channel Importance Matters in Few-Shot Image Classification Xu Luo, Jing Xu, Zenglin Xu arXiv_CV arXiv_CV Image_Caption Pose Classification Few-Shot Attention CNN Image_Classification PDF
2022-06-16 Image Captioning based on Feature Refinement and Reflective Decoding Ghadah Alabduljabbar, Hafida Benhidour, Said Kerrache arXiv_CV arXiv_CV Image_Caption Salient Pose Action Deep_Learning Attention Caption PDF
2022-06-15 A Unified Sequence Interface for Vision Tasks Ting Chen, Saurabh Saxena, Lala Li, Tsung-Yi Lin, David J. Fleet, Geoffrey Hinton arXiv_CV arXiv_CV Image_Caption Segmentation Face Detection Object_Detection Caption PDF
2022-06-15 Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang arXiv_CV arXiv_CV Image_Caption Transformer Detection VQA Object_Detection Attention Caption QA PDF
2022-06-15 Recent Advances in Scene Image Representation and Classification Chiranjibi Sitaula, Tej Bahadur Shahi, Faezeh Marzbanrad arXiv_CV arXiv_CV Image_Caption Review Pose Survey Quantitative Classification Deep_Learning Image_Classification PDF
2022-06-14 Measuring Representational Harms in Image Captioning Angelina Wang, Solon Barocas, Kristen Laird, Hanna Wallach arXiv_CV arXiv_CV Image_Caption Pose Face Caption PDF
2022-06-14 Self-Supervision on Images and Text Reduces Reliance on Visual Shortcut Features Anil Palepu, Andrew L Beam arXiv_CV arXiv_CV Image_Caption Self-Supervised Deep_Learning Medical PDF
2022-06-14 ReCo: Retrieve and Co-segment for Zero-shot Transfer Gyungin Shin, Weidi Xie, Samuel Albanie arXiv_CV arXiv_CV Image_Caption Segmentation Unsupervised Semantic_Segmentation Zero-Shot Knowledge Classification Prediction PDF
2022-06-14 Comprehending and Ordering Semantics for Image Captioning Yehao Li, Yingwei Pan, Ting Yao, Tao Mei arXiv_CL arXiv_CL Image_Caption Transformer Pose Detection Object_Detection Caption PDF
2022-06-12 GLIPv2: Unifying Localization and Vision-Language Understanding Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao arXiv_AI arXiv_AI Image_Caption Segmentation Zero-Shot Contrastive_Learning Detection VQA Few-Shot Object_Detection GAN Caption Language_Model QA PDF
2022-06-10 Zero-Shot Audio Classification using Image Embeddings Duygu Dogan, Huang Xie, Toni Heittola, Tuomas Virtanen arXiv_SD arXiv_SD Image_Caption Embedding Zero-Shot Classification Relation PDF
2022-06-09 SAR Despeckling using a Denoising Diffusion Probabilistic Model Malsha V. Perera, Nithin Gopalakrishnan Nair, Wele Gedara Chaminda Bandara, Vishal M. Patel arXiv_CV arXiv_CV Image_Caption Recognition Pose Quantitative Detection Denoising Inference PDF
2022-06-07 Improving Image Captioning with Control Signal of Sentence Quality Zhangzi Zhu, Hong Qu arXiv_CV arXiv_CV Image_Caption Pose Caption PDF
2022-06-07 Intra-agent speech permits zero-shot task acquisition Chen Yan, Federico Carnevale, Petko Georgiev, Adam Santoro, Aurelia Guy, Alistair Muldal, Chia-Chun Hung, Josh Abramson, Timothy Lillicrap, Gregory Wayne arXiv_AI arXiv_AI Image_Caption 3D Zero-Shot Speech Pose Action Caption PDF
2022-06-06 Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning Richard J. Chen, Chengkuan Chen, Yicong Li, Tiffany Y. Chen, Andrew D. Trister, Rahul G. Krishnan, Faisal Mahmood arXiv_CV arXiv_CV Image_Caption Transformer Self-Supervised Action Prediction PDF
2022-06-03 On the duality between contrastive and non-contrastive self-supervised learning Quentin Garrido (FAIR, LIGM), Yubei Chen (FAIR), Adrien Bardes (FAIR, WILLOW), Laurent Najman (LIGM), Yann Lecun (FAIR, CIMS) arXiv_AI arXiv_AI Image_Caption Optimization Self-Supervised Quantitative PDF
2022-06-02 3D-Augmented Contrastive Knowledge Distillation for Image-based Object Pose Estimation Zhidan Liu, Zhen Xing, Xiangdong Zhou, Yijiang Chen, Guichun Zhou arXiv_AI arXiv_AI Image_Caption 3D Pose_Estimation Knowledge Pose Contrastive_Learning PDF
2022-06-02 Prefix Conditioning Unifies Language and Label Supervision Kuniaki Saito, Kihyuk Sohn, Xiang Zhang, Chun-Liang Li, Chen-Yu Lee, Kate Saenko, Tomas Pfister arXiv_CV arXiv_CV Image_Caption Recognition Zero-Shot Pose Contrastive_Learning Caption PDF
2022-06-01 Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training Yan Zeng, Wangchunshu Zhou, Ao Luo, Xinsong Zhang arXiv_AI arXiv_AI Image_Caption Zero-Shot Contrastive_Learning Caption Language_Model PDF
2022-06-01 Dog nose print matching with dual global descriptor based on Contrastive Learning Bin Li, Zhongan Wang, Nan Wu, Shuai Shi, Qijun Ma arXiv_CV arXiv_CV Image_Caption Pose Contrastive_Learning Deep_Learning Matching PDF
2022-06-01 The Fully Convolutional Transformer for Medical Image Segmentation Athanasios Tragakis, Chaitanya Kaul, Roderick Murray-Smith, Dirk Husmeier arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Pose Medical CNN PDF
2022-06-01 Visual Transformer for Object Detection Michael Yang arXiv_CV arXiv_CV Image_Caption Transformer Pose Action Detection Object_Detection Attention Caption CNN PDF
2022-05-31 Unsupervised Image Representation Learning with Deep Latent Particles Tal Daniel, Aviv Tamar arXiv_AI arXiv_AI Image_Caption Unsupervised Represenation_Learning Video_Prediction Pose Detection Prediction PDF
2022-05-30 Self-Supervised Pre-training of Vision Transformers for Dense Prediction Tasks Jaonary Rabarisoa, Velentin Belissen, Florian Chabot, Quoc-Cuong Pham arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Semantic_Segmentation Self-Supervised Pose Prediction PDF
2022-05-28 BAN-Cap: A Multi-Purpose English-Bangla Image Descriptions Dataset Mohammad Faiyaz Khan, S.M. Sadiq-Ur-Rahman Shifath, Md Saiful Islam arXiv_CL arXiv_CL Image_Caption Pose Quantitative Attention Caption PDF
2022-05-28 Variational Transformer: A Framework Beyond the Trade-off between Accuracy and Diversity for Image Captioning Longzhen Yang, Shaohua Shang, Yihang Liu, Yitao Peng, Lianghua He arXiv_CV arXiv_CV Image_Caption Transformer Pose Relation Caption PDF
2022-05-27 GIT: A Generative Image-to-text Transformer for Vision and Language Jianfeng Wang, Zhengyuan Yang, Xiaowei Hu, Linjie Li, Kevin Lin, Zhe Gan, Zicheng Liu, Ce Liu, Lijuan Wang arXiv_CV arXiv_CV Image_Caption Transformer Recognition Video_Caption OCR Optical_Character Scene_Text Classification Detection Object_Detection Caption Image_Classification Language_Model PDF
2022-05-27 TraClets: Harnessing the power of computer vision for trajectory classification Ioannis Kontopoulos, Antonios Makris, Konstantinos Tserpes, Vania Bogorny arXiv_CV arXiv_CV Image_Caption Tracking Pose Classification PDF
2022-05-26 HIRL: A General Framework for Hierarchical Image Representation Learning Minghao Xu, Yuanfan Guo, Xuanyu Zhu, Jiawen Li, Zhenbang Sun, Jian Tang, Yi Xu, Bingbing Ni arXiv_CV arXiv_CV Image_Caption Represenation_Learning Self-Supervised Pose PDF
2022-05-26 Prompt-based Learning for Unpaired Image Captioning Peipei Zhu, Xiao Wang, Lin Zhu, Zhenglong Sun, Weishi Zheng, Yaowei Wang, Changwen Chen arXiv_CV arXiv_CV Image_Caption Reinforcement_Learning Knowledge Adversarial Pose Action Relation Caption PDF
2022-05-26 Fine-grained Image Captioning with CLIP Reward Jaemin Cho, Seunghyun Yoon, Ajinkya Kale, Franck Dernoncourt, Trung Bui, Mohit Bansal arXiv_AI arXiv_AI Image_Caption Unsupervised Image_Retrieval Salient Pose Relation Caption PDF
2022-05-25 Mutual Information Divergence: A Unified Metric for Multimodal Generative Models Jin-Hwa Kim, Yunji Kim, Jiyoung Lee, Kang Min Yoo, Sang-Woo Lee arXiv_AI arXiv_AI Image_Caption Represenation_Learning Pose Caption PDF
2022-05-25 Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Dataset Ashish V. Thapliyal, Jordi Pont-Tuset, Xi Chen, Radu Soricut arXiv_CV arXiv_CV Image_Caption Relation Caption PDF
2022-05-24 Face2Text revisited: Improved data set and baseline results Marc Tanti, Shaun Abdilla, Adrian Muscat, Claudia Borg, Reuben A. Farrugia, Albert Gatt arXiv_CV arXiv_CV Image_Caption Transfer_Learning RNN Face Attention PDF
2022-05-24 Rethinking Evaluation Practices in Visual Question Answering: A Case Study on Out-of-Distribution Generalization Aishwarya Agrawal, Ivana Kajić, Emanuele Bugliarello, Elnaz Davoodi, Anita Gergely, Phil Blunsom, Aida Nematzadeh arXiv_AI arXiv_AI Image_Caption Classification VQA Text_Generation Caption QA PDF
2022-05-24 mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections Chenliang Li, Haiyang Xu, Junfeng Tian, Wei Wang, Ming Yan, Bin Bi, Jiabo Ye, Hehong Chen, Guohai Xu, Zheng Cao, Ji Zhang, Songfang Huang, Fei Huang, Jingren Zhou arXiv_CV arXiv_CV Image_Caption Zero-Shot VQA Attention Caption PDF
2022-05-24 Symbolic Expression Transformer: A Computer Vision Approach for Symbolic Regression Jiachen Li, Ye Yuan, Hong-Bin Shen arXiv_AI arXiv_AI Image_Caption Transformer Pose Caption PDF
2022-05-24 On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization Shruti Palaskar, Akshita Bhagia, Yonatan Bisk, Florian Metze, Alan W Black, Ana Marasovic arXiv_CV arXiv_CV Image_Caption Action VQA Attention Text_Generation Caption Language_Model QA PDF
2022-05-23 Saliency-Driven Active Contour Model for Image Segmentation Ehtesham Iqbal, Asim Niaz, Asif Aziz Memon, Usman Asim, Kwang Nam Choi arXiv_CV arXiv_CV Image_Caption Segmentation Salient Pose Face Quantitative Contour Medical PDF
2022-05-21 Context Matters for Image Descriptions for Accessibility: Challenges for Referenceless Evaluation Metrics Elisa Kreiss, Cynthia Bennett, Shayan Hooshmand, Eric Zelikman, Meredith Ringel Morris, Christopher Potts arXiv_CL arXiv_CL Image_Caption PDF
2022-05-20 PGDP5K: A Diagram Parsing Dataset for Plane Geometry Problems Yihan Hao (1 and 2), Mingliang Zhang (2 and 3), Fei Yin (2 and 3), Linlin Huang (1) ((1) Beijing Jiaotong University, (2) Institute of Automation of Chinese Academy of Science, (3) University of Chinese Academy of Sciences) arXiv_CV arXiv_CV Image_Caption Knowledge Pose Relation Attention PDF
2022-05-18 Financial Time Series Data Augmentation with Generative Adversarial Networks and extended Intertemporal Return Plots Justin Hellermann, Qinzhuan Qian, Ankit Shah arXiv_CV arXiv_CV Image_Caption Regularization Adversarial Classification Relation GAN PDF
2022-05-18 It Isn't Sh!tposting, It's My CAT Posting Parthsarthi Rawat, Sayan Das, Jorge Aguirre, Akhil Daphara arXiv_AI arXiv_AI Image_Caption Transformer RNN Attention Caption PDF
2022-05-14 Object-Aware Self-supervised Multi-Label Learning Xu Kaixin, Liu Liyang, Zhao Ziyuan, Zeng Zeng, Bharadwaj Veeravalli arXiv_CV arXiv_CV Image_Caption Self-Supervised Pose Classification Deep_Learning PDF
2022-05-12 Localized Vision-Language Matching for Open-vocabulary Object Detection Maria A. Bravo, Sudhanshu Mittal, Thomas Brox arXiv_CV arXiv_CV Image_Caption Regularization Pose Detection Object_Detection Caption Language_Model Matching PDF
2022-05-12 A Computational Acquisition Model for Multimodal Word Categorization Uri Berger, Gabriel Stanovsky, Omri Abend, Lea Frermann arXiv_CL arXiv_CL Image_Caption Recognition Self-Supervised Pose Caption PDF
2022-05-11 CV4Code: Sourcecode Understanding via Visual Code Representations Ruibo Shi, Lili Tao, Rohan Saphal, Fran Silavong, Sean J. Moran arXiv_AI arXiv_AI Image_Caption Transformer Embedding Pose CNN PDF
2022-05-09 Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for Image Captioning Chia-Wen Kuo, Zsolt Kira arXiv_AI arXiv_AI Image_Caption Pose Quantitative Detection Relation Object_Detection Caption PDF
2022-05-07 GenISP: Neural ISP for Low-Light Machine Cognition Igor Morawski, Yu-An Chen, Yu-Sheng Lin, Shusil Dangi, Kai He, Winston H. Hsu arXiv_CV arXiv_CV Image_Caption Enhancement Restoration Pose Detection Object_Detection Inference PDF
2022-05-05 Language Models Can See: Plugging Visual Controls in Text Generation Yixuan Su, Tian Lan, Yahui Liu, Fangyu Liu, Dani Yogatama, Yan Wang, Lingpeng Kong, Nigel Collier arXiv_CV arXiv_CV Image_Caption Zero-Shot Pose Text_Generation Caption Language_Model Matching PDF
2022-05-05 AdaTriplet: Adaptive Gradient Triplet Loss with Automatic Margin Learning for Forensic Medical Image Matching Khanh Nguyen, Huy Hoang Nguyen, Aleksei Tiulpin arXiv_CV arXiv_CV Image_Caption Image_Retrieval Pose Medical Matching PDF
2022-05-05 Understanding Transfer Learning for Chest Radiograph Clinical Report Generation with Modified Transformer Architectures Edward Vendrow, Ethan Schonfeld arXiv_AI arXiv_AI Image_Caption Transformer Embedding Transfer_Learning Bert Pose Medical Caption PDF
2022-05-04 CoCa: Contrastive Captioners are Image-Text Foundation Models Jiahui Yu, Zirui Wang, Vijay Vasudevan, Legg Yeung, Mojtaba Seyedhosseini, Yonghui Wu arXiv_CV arXiv_CV Image_Caption Transformer Embedding Recognition Zero-Shot Represenation_Learning Classification VQA Attention Caption QA PDF
2022-05-04 All You May Need for VQA are Image Captions Soravit Changpinyo, Doron Kukliansky, Idan Szpektor, Xi Chen, Nan Ding, Radu Soricut arXiv_CV arXiv_CV Image_Caption Zero-Shot Pose VQA Caption QA PDF
2022-05-03 Diverse Image Captioning with Grounded Style Franz Klein, Shweta Mahajan, Stefan Roth arXiv_CV arXiv_CV Image_Caption Pose Sentiment Caption PDF
2022-05-02 Hausa Visual Genome: A Dataset for Multi-Modal English to Hausa Machine Translation Idris Abdulmumin, Satya Ranjan Dash, Musa Abdullahi Dawud, Shantipriya Parida, Shamsuddeen Hassan Muhammad, Ibrahim Sa'id Ahmad, Subhadarshi Panda, Ondřej Bojar, Bashir Shehu Galadanci, Bello Shehu Bello arXiv_CV arXiv_CV Image_Caption PDF
2022-05-02 Answer-Me: Multi-Task Open-Vocabulary Visual Question Answering AJ Piergiovanni, Wei Li, Weicheng Kuo, Mohammad Saffar, Fred Bertsch, Anelia Angelova arXiv_CV arXiv_CV Image_Caption Zero-Shot Pose VQA Caption QA PDF
2022-04-28 Keep the Caption Information: Preventing Shortcut Learning in Contrastive Image-Caption Retrieval Maurits Bleeker, Andrew Yates, Maarten de Rijke arXiv_AI arXiv_AI Image_Caption Reconstruction Optimization Caption PDF
2022-04-28 Controllable Image Captioning Luka Maxwell arXiv_CV arXiv_CV Image_Caption Transformer Speech Pose Caption PDF
2022-04-27 Self-Supervised Learning of Object Parts for Semantic Segmentation Adrian Ziegler, Yuki M. Asano arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Unsupervised Semantic_Segmentation Represenation_Learning Self-Supervised Pose Detection PDF
2022-04-27 CapOnImage: Context-driven Dense-Captioning on Image Yiqi Gao, Xinglin Hou, Yuanmeng Zhang, Tiezheng Ge, Yuning Jiang, Peng Wang arXiv_CV arXiv_CV Image_Caption Embedding Pose Caption PDF
2022-04-20 Self-supervised Learning for Sonar Image Classification Alan Preciado-Grijalva, Bilal Wehbe, Miguel Bande Firvida, Matias Valdenegro-Toro arXiv_CV arXiv_CV Image_Caption Transfer_Learning Self-Supervised Classification Few-Shot Denoising Image_Classification PDF
2022-04-20 Uncertainty-based Cross-Modal Retrieval with Probabilistic Representations Leila Pishdad, Ran Zhang, Konstantinos G. Derpanis, Allan Jepson, Afsaneh Fazly arXiv_CV arXiv_CV Image_Caption Embedding Image_Retrieval Pose Matching PDF
2022-04-20 K-LITE: Learning Transferable Visual Models with External Knowledge Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Anna Rohrbach, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Jianfeng Gao arXiv_AI arXiv_AI Image_Caption Transfer_Learning Zero-Shot Knowledge Pose Classification Detection Few-Shot Object_Detection Caption Image_Classification PDF
2022-04-18 Cross-view Brain Decoding Subba Reddy Oota, Jashn Arora, Manish Gupta, Raju S. Bapi arXiv_AI arXiv_AI Image_Caption Zero-Shot Pose Action Caption PDF
2022-04-18 Optical Remote Sensing Image Understanding with Weak Supervision: Concepts, Methods, and Perspectives Jun Yue, Leyuan Fang, Pedram Ghamisi, Weiying Xie, Jun Li, Jocelyn Chanussot, Antonio J Plaza arXiv_CV arXiv_CV Image_Caption Segmentation Weakly_Supervised Face Classification Detection Object_Detection Image_Classification PDF
2022-04-16 Language-Grounded Indoor 3D Semantic Segmentation in the Wild David Rozenberszki, Or Litany, Angela Dai arXiv_CV arXiv_CV Image_Caption Segmentation Embedding Semantic_Segmentation 3D Pose PDF
2022-04-15 It is Okay to Not Be Okay: Overcoming Emotional Bias in Affective Image Captioning by Contrastive Data Collection Youssef Mohamed, Faizan Farooq Khan, Kilichbek Haydarov, Mohamed Elhoseiny arXiv_AI arXiv_AI Image_Caption Pose Emotion Action Caption PDF
2022-04-15 Guiding Attention using Partial-Order Relationships for Image Captioning Murad Popattia, Muhammad Rafi, Rizwan Qureshi, Shah Nawaz arXiv_CV arXiv_CV Image_Caption Embedding Pose Relation Attention Caption PDF
2022-04-15 COTS: Collaborative Two-Stream Vision-Language Pre-Training Model for Cross-Modal Retrieval Haoyu Lu, Nanyi Fei, Yuqi Huo, Yizhao Gao, Zhiwu Lu, Ji-Rong Wen arXiv_CV arXiv_CV Image_Caption Pose Contrastive_Learning Face Action Attention Inference Language_Model Video_Retrieval PDF
2022-04-15 Image Captioning In the Transformer Age Yang Xu, Li Li, Haiyang Xu, Songfang Huang, Fei Huang, Jianfei Cai arXiv_CV arXiv_CV Image_Caption Transformer RNN Self-Supervised Survey Caption PDF
2022-04-15 Guided Co-Modulated GAN for 360{deg} Field of View Extrapolation Mohammad Reza Karimi Dastjerdi, Yannick Hold-Geoffroy, Jonathan Eisenmann, Siavash Khodadadeh, Jean-François Lalonde arXiv_CV arXiv_CV Image_Caption Pose Quantitative GAN PDF
2022-04-14 Masked Siamese Networks for Label-Efficient Learning Mahmoud Assran, Mathilde Caron, Ishan Misra, Piotr Bojanowski, Florian Bordes, Pascal Vincent, Armand Joulin, Michael Rabbat, Nicolas Ballas arXiv_AI arXiv_AI Image_Caption Transformer Embedding Self-Supervised Pose Classification Image_Classification PDF
2022-04-13 Hierarchical Text-Conditional Image Generation with CLIP Latents Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, Mark Chen arXiv_CV arXiv_CV Image_Caption Embedding Zero-Shot Pose Caption PDF
2022-04-10 TOV: The Original Vision Model for Optical Remote Sensing Image Understanding via Self-supervised Learning Chao Tao, Ji Qia, Guo Zhang, Qing Zhu, Weipeng Lu, Haifeng Li arXiv_AI arXiv_AI Image_Caption Segmentation Semantic_Segmentation Scene_Classification Optimization Knowledge Self-Supervised Pose Classification Detection Object_Detection PDF
2022-04-10 Robust Cross-Modal Representation Learning with Progressive Self-Distillation Alex Andonian, Shixing Chen, Raffay Hamid arXiv_CV arXiv_CV Image_Caption Zero-Shot Represenation_Learning Knowledge Contrastive_Learning Classification Caption PDF
2022-04-09 Joint Distribution Matters: Deep Brownian Distance Covariance for Few-Shot Classification Jiangtao Xie, Fei Long, Jiaming Lv, Qilong Wang, Peihua Li arXiv_CV arXiv_CV Image_Caption Embedding Recognition Pose Classification Few-Shot PDF
2022-04-09 Mapping Temporary Slums from Satellite Imagery using a Semi-Supervised Approach M. Fasi ur Rehman, Izza Ali, Waqas Sultani, Mohsen Ali arXiv_CV arXiv_CV Image_Caption Segmentation Embedding Semantic_Segmentation Represenation_Learning Pose Deep_Learning Detection PDF
2022-04-08 Semantic Exploration from Language Abstractions and Pretrained Representations Allison C. Tam, Neil C. Rabinowitz, Andrew K. Lampinen, Nicholas A. Roy, Stephanie C. Y. Chan, DJ Strouse, Jane X. Wang, Andrea Banino, Felix Hill arXiv_AI arXiv_AI Image_Caption Reinforcement_Learning 3D Pose Action Caption PDF
2022-04-08 Characterizing and Understanding the Behavior of Quantized Models for Reliable Deployment Qiang Hu, Yuejun Guo, Maxime Cordy, Xiaofei Xie, Wei Ma, Mike Papadakis, Yves Le Traon arXiv_AI arXiv_AI Image_Caption Quantization RNN Adversarial Pose Attention Language_Model PDF
2022-04-08 On Distinctive Image Captioning via Comparing and Reweighting Jiuniu Wang, Wenjia Xu, Qingzhong Wang, Antoni B. Chan arXiv_AI arXiv_AI Image_Caption Pose Caption PDF
2022-04-07 ECCV Caption: Correcting False Negatives by Collecting Machine-and-Human-verified Image-Caption Associations for MS-COCO Sanghyuk Chun, Wonjae Kim, Song Park, Minsuk Chang, Seong Joon Oh arXiv_CV arXiv_CV Image_Caption Pose Caption Matching PDF
2022-04-07 Adversarial Machine Learning Attacks Against Video Anomaly Detection Systems Furkan Mumcu, Keval Doshi, Yasin Yilmaz arXiv_AI arXiv_AI Image_Caption Surveillance Video_Caption Adversarial Detection PDF
2022-04-06 An Empirical Study of Remote Sensing Pretraining Di Wang, Jing Zhang, Bo Du, Gui-Song Xia, Dacheng Tao arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Semantic_Segmentation Recognition Deep_Learning Detection Object_Detection CNN PDF
2022-04-05 Hospital-Agnostic Image Representation Learning in Digital Pathology Milad Sikaroudi, Shahryar Rahnamayan, H.R. Tizhoosh arXiv_CV arXiv_CV Image_Caption Represenation_Learning Pose Classification PDF
2022-04-05 High-Quality Pluralistic Image Completion via Code Shared VQGAN Chuanxia Zheng, Guoxian Song, Tat-Jen Cham, Jianfei Cai, Dinh Phung, Linjie Luo arXiv_CV arXiv_CV Image_Caption Transformer Reconstruction Quantitative GAN Inference PDF
2022-04-04 Attribute Prototype Network for Any-Shot Learning Wenjia Xu, Yongqin Xian, Jiuniu Wang, Bernt Schiele, Zeynep Akata arXiv_CV arXiv_CV Image_Caption Embedding Zero-Shot Represenation_Learning Knowledge Pose Quantitative Classification Few-Shot Image_Classification PDF
2022-04-02 Do learned representations respect causal relationships? Lan Wang, Vishnu Naresh Boddeti arXiv_CV arXiv_CV Image_Caption 3D Represenation_Learning Pose Face Relation PDF
2022-04-01 Learning Audio-Video Modalities from Image Captions Arsha Nagrani, Paul Hongsuck Seo, Bryan Seybold, Anja Hauth, Santiago Manen, Chen Sun, Cordelia Schmid arXiv_CV arXiv_CV Image_Caption Video_Caption Pose Caption Video_Retrieval Matching PDF
2022-04-01 Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language Andy Zeng, Adrian Wong, Stefan Welker, Krzysztof Choromanski, Federico Tombari, Aveek Purohit, Michael Ryoo, Vikas Sindhwani, Johnny Lee, Vincent Vanhoucke, Pete Florence arXiv_AI arXiv_AI Image_Caption OCR Zero-Shot Knowledge Pose Caption Language_Model PDF
2022-04-01 Stereo Unstructured Magnification: Multiple Homography Image for View Synthesis Qi Zhang, Xin Huang, Ying Feng, Xue Wang, Hongdong Li, Qing Wang arXiv_CV arXiv_CV Image_Caption Reconstruction Pose Quantitative PDF
2022-03-31 Misogynistic Meme Detection using Early Fusion Model with Graph Network Harshvardhan Srivastava arXiv_CL arXiv_CL Image_Caption Transformer Pose Detection Language_Model Prediction PDF
2022-03-30 Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data Corentin Sautier, Gilles Puy, Spyros Gidaris, Alexandre Boulch, Andrei Bursuc, Renaud Marlet arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation Point_Cloud 3D Sparse Self-Supervised Pose Detection Object_Detection Autonomous Matching PDF
2022-03-29 NICGSlowDown: Evaluating the Efficiency Robustness of Neural Image Caption Generation Models Simin Chen, Zihe Song, Mirazul Haque, Cong Liu, Wei Yang arXiv_AI arXiv_AI Image_Caption Pose Face Attention Caption PDF
2022-03-29 Quantifying Societal Bias Amplification in Image Captioning Yusuke Hirota, Yuta Nakashima, Noa Garcia arXiv_CV arXiv_CV Image_Caption Pose Caption Prediction PDF
2022-03-29 Self-Supervised Image Representation Learning with Geometric Set Consistency Nenglun Chen, Lei Chu, Hao Pan, Yan Lu, Wenping Wang arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation 3D Represenation_Learning Self-Supervised Pose Contrastive_Learning Face Detection Object_Detection PDF
2022-03-29 End-to-End Transformer Based Model for Image Captioning Yiyu Wang, Jungang Xu, Yingfei Sun arXiv_CV arXiv_CV Image_Caption Transformer RNN Pose Action Relation GAN Caption PDF
2022-03-27 Knowledge Mining with Scene Text for Fine-Grained Recognition Hao Wang, Junchao Liao, Tianheng Cheng, Zewen Gao, Hao Liu, Bo Ren, Xiang Bai, Wenyu Liu arXiv_CV arXiv_CV Image_Caption Recognition Bert Knowledge Pose Scene_Text Action Classification Relation Activity Image_Classification PDF
2022-03-25 Spatially Multi-conditional Image Generation Ritika Chakraborty, Nikola Popovic, Danda Pani Paudel, Thomas Probst, Luc Van Gool arXiv_CV arXiv_CV Image_Caption Transformer Adversarial Pose PDF
2022-03-24 Linking Emergent and Natural Languages via Corpus Transfer Shunyu Yao, Mo Yu, Yang Zhang, Karthik R Narasimhan, Joshua B. Tenenbaum, Chuang Gan arXiv_CL arXiv_CL Image_Caption Pose Relation Caption Language_Model PDF
2022-03-23 StructToken : Rethinking Semantic Segmentation with Structural Prior Fangjian Lin, Zhanhao Liang, Junjun He, Miao Zheng, Shengwei Tian, Kai Chen arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation Pose Action Classification Deep_Learning PDF
2022-03-23 GOSS: Towards Generalized Open-set Semantic Segmentation Jie Hong, Weihao Li, Junlin Han, Jiyang Zheng, Pengfei Fang, Mehrtash Harandi, Lars Petersson arXiv_RO arXiv_RO Image_Caption Segmentation Semantic_Segmentation Pose Classification PDF
2022-03-22 WuDaoMM: A large-scale Multi-Modal Dataset for Pre-training models Sha Yuan, Zhao Shuai, Leng Jiahong, Xue Zhao, Zhao Hanyu, Tang Jie arXiv_CL arXiv_CL Image_Caption Transformer Relation VQA Caption QA PDF
2022-03-22 Self-Supervised Representation Learning as Multimodal Variational Inference Hiroki Nakamura, Masashi Okada, Tadahiro Taniguchi arXiv_CV arXiv_CV Image_Caption Represenation_Learning Self-Supervised Pose Classification Relation Inference PDF
2022-03-20 Partitioning Image Representation in Contrastive Learning Hyunsub Lee, Heeyoul Choi arXiv_AI arXiv_AI Image_Caption Contrastive_Learning Classification Few-Shot PDF
2022-03-18 Nonnegative-Constrained Joint Collaborative Representation with Union Dictionary for Hyperspectral Anomaly Detection Shizhen Chang, Pedram Ghamisi arXiv_CV arXiv_CV Image_Caption Optimization Regularization Pose Detection Object_Detection PDF
2022-03-18 AlignTransformer: Hierarchical Alignment of Visual Regions and Disease Tags for Medical Report Generation Di You, Fenglin Liu, Shen Ge, Xiaoxia Xie, Jing Zhang, Xian Wu arXiv_CV arXiv_CV Image_Caption Transformer Pose Attention Medical Caption PDF
2022-03-17 On Vision Features in Multimodal Machine Translation Bei Li, Chuanhao Lv, Zefan Zhou, Tao Zhou, Tong Xiao, Anxiang Ma, JingBo Zhu arXiv_CL arXiv_CL Image_Caption Transformer Detection Attention Caption PDF
2022-03-17 UNIMO-2: End-to-End Unified Vision-Language Grounded Learning Wei Li, Can Gao, Guocheng Niu, Xinyan Xiao, Hao Liu, Jiachen Liu, Hua Wu, Haifeng Wang arXiv_CV arXiv_CV Image_Caption Transformer Pose Caption PDF
2022-03-17 DU-VLG: Unifying Vision-and-Language Generation via Dual Sequence-to-Sequence Pre-training Luyang Huang, Guocheng Niu, Jiachen Liu, Xinyan Xiao, Hua Wu arXiv_AI arXiv_AI Image_Caption Pose Denoising Caption PDF
2022-03-14 Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer Woojeong Jin, Dong-Ho Lee, Chenguang Zhu, Jay Pujara, Xiang Ren arXiv_CL arXiv_CL Image_Caption Knowledge Caption Language_Model PDF
2022-03-14 Contrastive Visual Semantic Pretraining Magnifies the Semantics of Natural Language Representations Robert Wolfe, Aylin Caliskan arXiv_CL arXiv_CL Image_Caption Embedding Zero-Shot Caption PDF
2022-03-14 Generalized Rectifier Wavelet Covariance Models For Texture Synthesis Antoine Brochard, Sixin Zhang, Stéphane Mallat arXiv_CV arXiv_CV Image_Caption Pose CNN PDF
2022-03-14 CLIP Models are Few-shot Learners: Empirical Studies on VQA and Visual Entailment Haoyu Song, Li Dong, Wei-Nan Zhang, Ting Liu, Furu Wei arXiv_CL arXiv_CL Image_Caption Zero-Shot Pose VQA Few-Shot Caption QA PDF
2022-03-13 Depth-Aware Generative Adversarial Network for Talking Head Video Generation Fa-Ting Hong, Longhao Zhang, Li Shen, Dan Xu arXiv_CV arXiv_CV Image_Caption 3D Sparse Adversarial Self-Supervised Pose Face Attention GAN PDF
2022-03-12 Chart-to-Text: A Large-Scale Benchmark for Chart Summarization Shankar Kanthara, Rixie Tiffany Ko Leong, Xiang Lin, Ahmed Masry, Megh Thakkar, Enamul Hoque, Shafiq Joty arXiv_CL arXiv_CL Image_Caption Summarization Text_Generation Caption PDF
2022-03-12 Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation Wenliang Dai, Lu Hou, Lifeng Shang, Xin Jiang, Qun Liu, Pascale Fung arXiv_AI arXiv_AI Image_Caption Zero-Shot Knowledge Pose VQA Caption Language_Model QA PDF
2022-03-11 Perception Over Time: Temporal Dynamics for Robust Image Understanding Maryam Daniali, Edward Kim arXiv_CV arXiv_CV Image_Caption Adversarial Pose Quantitative Classification Deep_Learning PDF
2022-03-10 Two-stream Hierarchical Similarity Reasoning for Image-text Matching Ran Chen, Hanli Wang, Lei Wang, Sam Kwong arXiv_CV arXiv_CV Image_Caption Pose Action Matching PDF
2022-03-09 NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks Fawaz Sammani, Tanmoy Mukherjee, Nikos Deligiannis arXiv_CV arXiv_CV Image_Caption VQA Caption Inference Language_Model Prediction QA PDF
2022-03-09 Efficient Image Representation Learning with Federated Sampled Softmax Sagar M. Waghmare, Hang Qi, Huizhong Chen, Mikhail Sirotenko, Tomer Meron arXiv_CV arXiv_CV Image_Caption Represenation_Learning PDF
2022-03-08 Semantic Distillation Guided Salient Object Detection Bo Xu, Guanze Liu, Han Huang, Cheng Lu, Yandong Guo arXiv_CL arXiv_CL Image_Caption Transformer Segmentation Salient Knowledge Pose Detection Object_Detection Caption PDF
2022-03-08 Mutual Contrastive Learning to Disentangle Whole Slide Image Representations for Glioma Grading Lipei Zhang, Yiran Wei, Ying Fu, Stephen Price, Carola-Bibiane Schönlieb, Chao Li arXiv_CV arXiv_CV Image_Caption Pose Contrastive_Learning PDF
2022-03-07 OverlapTransformer: An Efficient and Rotation-Invariant Transformer Network for LiDAR-Based Place Recognition Junyi Ma, Jun Zhang, Jintao Xu, Rui Ai, Weihao Gu, Cyrill Stachniss, Xieyuanli Chen arXiv_RO arXiv_RO Image_Caption Transformer Recognition 3D Pose SLAM Autonomous PDF
2022-03-07 Least Square Estimation Network for Depth Completion Xianze Fang, Zexi Chen, Yunkai Wang, Yue Wang, Rong Xiong arXiv_RO arXiv_RO Image_Caption Sparse Pose PDF
2022-03-07 Dynamic MLP for Fine-Grained Image Classification by Leveraging Geographical and Temporal Information Lingfeng Yang, Xiang Li, Renjie Song, Borui Zhao, Juntian Tao, Shihao Zhou, Jiajun Liang, Jian Yang arXiv_CV arXiv_CV Image_Caption Embedding Knowledge Pose Classification Image_Classification PDF
2022-03-07 Unpaired Image Captioning by Image-level Weakly-Supervised Visual Concept Recognition Peipei Zhu, Xiao Wang, Yong Luo, Zhenglong Sun, Wei-Shi Zheng, Yaowei Wang, Changwen Chen arXiv_CV arXiv_CV Image_Caption Recognition Optimization Knowledge Pose Relation Caption PDF
2022-03-04 DiT: Self-supervised Pre-training for Document Image Transformer Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei arXiv_CV arXiv_CV Image_Caption Transformer Self-Supervised Pose Classification Detection Image_Classification PDF
2022-03-04 FS-COCO: Towards Understanding of Freehand Sketches of Common Objects in Context Pinaki Nath Chowdhury, Aneeshan Sain, Yulia Gryaditskaya, Ayan Kumar Bhunia, Tao Xiang, Yi-Zhe Song arXiv_CV arXiv_CV Image_Caption Sketch RNN Image_Retrieval Pose Action Caption PDF
2022-03-03 Fast Neural Architecture Search for Lightweight Dense Prediction Networks Lam Huynh, Esa Rahtu, Jiri Matas, Janne Heikkila arXiv_CV arXiv_CV Image_Caption Surveillance NAS Segmentation Semantic_Segmentation Super_Resolution Classification Medical Prediction PDF
2022-03-03 A Deep Neural Framework for Image Caption Generation Using GRU-Based Attention Mechanism Rashid Khan, M Shujah Islam, Khadija Kanwal, Mansoor Iqbal, Md. Imran Hossain, Zhongfu Ye arXiv_CV arXiv_CV Image_Caption RNN Attention Caption CNN Language_Model PDF
2022-03-02 A Principled Design of Image Representation: Towards Forensic Tasks Shuren Qi, Yushu Zhang, Chao Wang, Jiantao Zhou, Xiaochun Cao arXiv_CV arXiv_CV Image_Caption Pose Action Detection Matching PDF
2022-02-28 Interactive Machine Learning for Image Captioning Mareike Hartmann, Aliki Anagnostopoulou, Daniel Sonntag arXiv_CV arXiv_CV Image_Caption Review Pose Caption PDF
2022-02-27 Meta-RangeSeg: LiDAR Sequence Semantic Segmentation Using Multiple Feature Aggregation Song Wang, Jianke Zhu, Ruixiang Zhang arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation Point_Cloud 3D Pose CNN Autonomous PDF
2022-02-24 New Benchmark for Household Garbage Image Recognition Zhize Wu, Huanyi Li, Xiaofeng Wang, Zijun Wu, Le Zou, Lixiang Xu, Ming Tan arXiv_CV arXiv_CV Image_Caption Recognition Represenation_Learning Face Classification Deep_Learning CNN Image_Classification PDF
2022-02-21 CaMEL: Mean Teacher Learning for Image Captioning Manuele Barraco, Matteo Stefanini, Marcella Cornia, Silvia Cascianelli, Lorenzo Baraldi, Rita Cucchiara arXiv_CV arXiv_CV Image_Caption Transformer Knowledge Pose Action Caption Language_Model PDF
2022-02-18 A Survey of Vision-Language Pre-Trained Models Yifan Du, Zikang Liu, Junyi Li, Wayne Xin Zhao arXiv_CV arXiv_CV Image_Caption Transformer Embedding Review Survey Action PDF
2022-02-18 AMS_ADRN at SemEval-2022 Task 5: A Suitable Image-text Multimodal Joint Modeling Method for Multi-task Misogyny Identification Da Li, Ming Yi, Yukai He arXiv_CL arXiv_CL Image_Caption Transformer Embedding Bert PDF
2022-02-16 Edge Data Based Trailer Inception Probabilistic Matrix Factorization for Context-Aware Movie Recommendation Honglong Chen, Zhe Li, Zhu Wang, Zhichen Ni, Junjian Li, Ge Xu, Abdul Aziz, Feng Xia arXiv_CV arXiv_CV Image_Caption Sparse Pose Action Caption CNN Prediction Recommendation PDF
2022-02-14 Do Lessons from Metric Learning Generalize to Image-Caption Retrieval? Maurits Bleeker, Maarten de Rijke arXiv_AI arXiv_AI Image_Caption Optimization Represenation_Learning Image_Retrieval Caption PDF
2022-02-14 I-Tuning: Tuning Language Models with Image for Caption Generation Ziyang Luo, Yadong Xi, Rongsheng Zhang, Jing Ma arXiv_CV arXiv_CV Image_Caption Pose Caption Language_Model PDF
2022-02-11 A Wasserstein GAN for Joint Learning of Inpainting and its Spatial Optimisation Pascal Peter arXiv_CV arXiv_CV Image_Caption Inpainting Restoration Sparse Adversarial Pose GAN PDF
2022-02-11 Bench-Marking And Improving Arabic Automatic Image Captioning Through The Use Of Multi-Task Learning Paradigm Muhy Eddin Za'ter, Bashar Talaftha arXiv_CV arXiv_CV Image_Caption Embedding Caption PDF
2022-02-11 ACORT: A Compact Object Relation Transformer for Parameter Efficient Image Captioning Jia Huei Tan, Ying Hua Tan, Chee Seng Chan, Joon Huang Chuah arXiv_CV arXiv_CV Image_Caption Transformer Pose Relation Attention Caption PDF
2022-02-10 Describing image focused in cognitive and visual details for visually impaired people: An approach to generating inclusive paragraphs Daniel Louzada Fernandes, Marcos Henrique Fonseca Ribeiro, Fabio Ribeiro Cerqueira, Michel Melo Silva arXiv_CV arXiv_CV Image_Caption Pose Caption Language_Model PDF
2022-02-08 DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generative Transformers Jaemin Cho, Abhay Zala, Mohit Bansal arXiv_CV arXiv_CV Image_Caption Transformer Image_Generation Recognition Pose Classification Relation Attention Caption Image_Classification Language_Model PDF
2022-02-08 Wireless Transmission of Images With The Assistance of Multi-level Semantic Information Zhenguo Zhang, Qianqian Yang, Shibo He, Mingyang Sun, Jiming Chen arXiv_CV arXiv_CV Image_Caption Segmentation Pose Deep_Learning Caption PDF
2022-02-08 Self-supervised Contrastive Learning for Cross-domain Hyperspectral Image Representation Hyungtae Lee, Heesung Kwon arXiv_CV arXiv_CV Image_Caption Transfer_Learning Self-Supervised Pose Contrastive_Learning Classification Attention PDF
2022-02-07 Motion-Plane-Adaptive Inter Prediction in 360-Degree Video Coding Andy Regensky, Christian Herglotz, André Kaup arXiv_CV arXiv_CV Image_Caption 3D Pose Prediction PDF
2022-02-07 Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework Peng Wang, An Yang, Rui Men, Junyang Lin, Shuai Bai, Zhikang Li, Jianxin Ma, Chang Zhou, Jingren Zhou, Hongxia Yang arXiv_CV arXiv_CV Image_Caption Bert Pose Classification VQA Text_Generation Caption Image_Classification QA PDF
2022-02-01 HCSC: Hierarchical Contrastive Selective Coding Yuanfan Guo, Minghao Xu, Jiawen Li, Bingbing Ni, Xuanyu Zhu, Zhenbang Sun, Yi Xu arXiv_CV arXiv_CV Image_Caption Represenation_Learning Pose Contrastive_Learning PDF
2022-01-31 Deep Learning Approaches on Image Captioning: A Review Taraneh Ghandi, Hamidreza Pourreza, Hamidreza Mahyar arXiv_CV arXiv_CV Image_Caption Review Survey Deep_Learning Caption PDF
2022-01-30 VC-GPT: Visual Conditioned GPT for End-to-End Generative Vision-and-Language Pre-training Ziyang Luo, Yadong Xi, Rongsheng Zhang, Jing Ma arXiv_CV arXiv_CV Image_Caption Pose Attention Caption PDF
2022-01-28 BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Junnan Li, Dongxu Li, Caiming Xiong, Steven Hoi arXiv_CV arXiv_CV Image_Caption Zero-Shot Pose VQA Caption QA PDF
2022-01-26 Evaluating language-biased image classification based on semantic representations Yoann Lemesle, Masataka Sawayama, Guillermo Valle-Perez, Maxime Adolphe, Hélène Sauzéon, Pierre-Yves Oudeyer arXiv_CV arXiv_CV Image_Caption Recognition Pose Classification Relation Image_Classification PDF
2022-01-25 Projective Urban Texturing Yiangos Georgiou, Melinos Averkiou, Tom Kelly, Evangelos Kalogerakis arXiv_CV arXiv_CV Image_Caption 3D Adversarial Pose Quantitative PDF
2022-01-23 Average Biased ReLU Based CNN Descriptor for Improved Face Retrieval Shiv Ram Dubey, Soumendu Chakraborty arXiv_CV arXiv_CV Image_Caption Pose Face CNN PDF
2022-01-23 An Integrated Approach for Video Captioning and Applications Soheyla Amirian, Thiab R. Taha, Khaled Rasheed, Hamid R. Arabnia arXiv_AI arXiv_AI Image_Caption Video_Caption Deep_Learning Caption PDF
2022-01-22 Visual Information Guided Zero-Shot Paraphrase Generation Zhe Lin, Xiaojun Wan arXiv_AI arXiv_AI Image_Caption Zero-Shot Pose Attention Caption PDF
2022-01-21 A System for Image Understanding using Sensemaking and Narrative Zev Battad, Mei Si arXiv_AI arXiv_AI Image_Caption Knowledge Inference PDF
2022-01-20 CELESTIAL: Classification Enabled via Labelless Embeddings with Self-supervised Telescope Image Analysis Learning Suhas Kotha, Anirudh Koul, Siddha Ganju, Meher Kasam arXiv_CV arXiv_CV Image_Caption Embedding Unsupervised Scene_Classification Sparse Image_Retrieval Knowledge Self-Supervised Classification PDF
2022-01-17 A Novel Framework to Jointly Compress and Index Remote Sensing Images for Efficient Content-Based Retrieval Jun Xiang, Gencer Sumbul, Nimisha Thekke Madam, Begüm Demir arXiv_CV arXiv_CV Image_Caption Image_Retrieval Pose Classification Image_Compression PDF
2022-01-16 PETS-SWINF: A regression method that considers images with metadata based Neural Network for pawpularity prediction on 2021 Kaggle Competition 'PetFinder.my' Yizheng Wang, Yinghua Liu arXiv_AI arXiv_AI Image_Caption Pose Prediction PDF
2022-01-14 Multimodal registration of FISH and nanoSIMS images using convolutional neural network models Xiaojia He, Christof Meile, Suchendra M. Bhandarkar arXiv_CV arXiv_CV Image_Caption Action Activity CNN Matching PDF
2022-01-14 A Thousand Words Are Worth More Than a Picture: Natural Language-Centric Outside-Knowledge Visual Question Answering Feng Gao, Qing Ping, Govind Thattai, Aishwarya Reganti, Ying Nian Wu, Prem Natarajan arXiv_CV arXiv_CV Image_Caption Knowledge Pose VQA GAN Language_Model QA PDF
2022-01-11 Uni-EDEN: Universal Encoder-Decoder Network by Multi-Granular Vision-Language Pre-training Yehao Li, Jiahao Fan, Yingwei Pan, Ting Yao, Weiyao Lin, Tao Mei arXiv_CV arXiv_CV Image_Caption Transformer Knowledge Action Classification VQA Caption Language_Model Matching PDF
2022-01-10 Cross-Modality Sub-Image Retrieval using Contrastive Multimodal Image Representations Eva Breznik, Elisabeth Wetzer, Joakim Lindblad, Nataša Sladoje arXiv_CV arXiv_CV Image_Caption Image_Retrieval Adversarial Pose Deep_Learning GAN PDF
2022-01-07 Repurposing Existing Deep Networks for Caption and Aesthetic-Guided Image Cropping Nora Horanyi, Kedi Xia, Kwang Moo Yi, Abhishake Kumar Bojja, Ales Leonardis, Hyung Jin Chang arXiv_CV arXiv_CV Image_Caption Optimization Pose Action Quantitative Caption PDF
2022-01-06 A wearable sensor vest for social humanoid robots with GPGPU, IoT, and modular software architecture Mohsen Jafarzadeh, Stephen Brooks, Shimeng Yu, Balakrishnan Prabhakaran, Yonas Tadesse arXiv_AI arXiv_AI Image_Caption Gesture Speech Pose Face Action PDF
2022-01-06 TransVPR: Transformer-based place recognition with multi-level attention aggregation Ruotong Wang, Yanqing Shen, Weiliang Zuo, Sanping Zhou, Nanning Zhen arXiv_CV arXiv_CV Image_Caption Transformer Recognition Attention Autonomous Matching PDF
2022-01-06 Compact Bidirectional Transformer for Image Captioning Yuanen Zhou, Zhenzhen Hu, Daqing Liu, Huixia Ben, Meng Wang arXiv_CV arXiv_CV Image_Caption Transformer Regularization Action Caption PDF
2022-01-05 Synthesizing Tensor Transformations for Visual Self-attention Xian Wei, Xihao Wang, Hai Lan, JiaMing Lei, Yanhui Huang, Hui Yu, Jian Yang arXiv_CV arXiv_CV Image_Caption Pose Classification Relation Attention Caption Image_Classification PDF
2022-01-04 Sound and Visual Representation Learning with Multiple Pretraining Tasks Arun Balajee Vasudevan, Dengxin Dai, Luc Van Gool arXiv_CV arXiv_CV Image_Caption Super_Resolution Represenation_Learning Self-Supervised Pose Classification Detection Prediction Video_Retrieval PDF
2022-01-04 StyleM: Stylized Metrics for Image Captioning Built with Contrastive N-grams Chengxi Li, Brent Harrison arXiv_AI arXiv_AI Image_Caption Caption PDF
2022-01-04 Interactive Attention AI to translate low light photos to captions for night scene understanding in women safety Rajagopal A, Nirmala V, Arun Muthuraj Vedamanickam arXiv_CV arXiv_CV Image_Caption Enhancement Image_Enhancement Deep_Learning VQA Attention Caption Language_Model PDF
2021-12-31 ERNIE-ViLG: Unified Generative Pre-training for Bidirectional Vision-Language Generation Han Zhang, Weichong Yin, Yewei Fang, Lanxin Li, Boqiang Duan, Zhihua Wu, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang arXiv_CV arXiv_CV Image_Caption Transformer Quantization Pose Text_Generation Caption PDF
2021-12-30 Continually Learning Self-Supervised Representations with Projected Functional Regularization Alex Gomez-Villa, Bartlomiej Twardowski, Lu Yu, Andrew D. Bagdanov, Joost van de Weijer arXiv_CV arXiv_CV Image_Caption Regularization Knowledge Self-Supervised Pose PDF
2021-12-30 Knowledge Matters: Radiology Report Generation with General and Specific Knowledge Shuxin Yang, Xian Wu, Shen Ge, Shaohua Kevin Zhou, Li Xiao arXiv_CV arXiv_CV Image_Caption Knowledge Pose Attention Medical Caption PDF
2021-12-28 Extended Self-Critical Pipeline for Transforming Videos to Text -- Team: MMCUniAugsburg Philipp Harzig, Moritz Einfalt, Katja Ludwig, Rainer Lienhart arXiv_CV arXiv_CV Image_Caption Transformer Attention Caption PDF
2021-12-28 Synchronized Audio-Visual Frames with Fractional Positional Encoding for Transformers in Video-to-Text Translation Philipp Harzig, Moritz Einfalt, Rainer Lienhart arXiv_CV arXiv_CV Image_Caption Transformer Action Caption PDF
2021-12-27 A Fistful of Words: Learning Transferable Visual Models from Bag-of-Words Supervision Ajinkya Tejankar, Ajinkya Tejankar, Bichen Wu, Saining Xie, Madian Khabsa, Hamed Pirsiavash, Hamed Firooz arXiv_CV arXiv_CV Image_Caption Recognition Zero-Shot Classification Caption Image_Classification PDF
2021-12-20 MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Grounding Revanth Gangi Reddy, Xilin Rui, Manling Li, Xudong Lin, Haoyang Wen, Jaemin Cho, Lifu Huang, Mohit Bansal, Avirup Sil, Shih-Fu Chang, Alexander Schwing, Heng Ji arXiv_CV arXiv_CV Image_Caption Knowledge Action Caption QA PDF
2021-12-16 Distilled Dual-Encoder Model for Vision-Language Understanding Zekun Wang, Wenhui Wang, Haichao Zhu, Ming Liu, Bing Qin, Furu Wei arXiv_CV arXiv_CV Image_Caption Pose Action VQA Attention Inference PDF
2021-12-14 Stochastic Actor-Executor-Critic for Image-to-Image Translation Ziwei Luo, Jing Hu, Xin Wang, Siwei Lyu, Bin Kong, Youbing Yin, Qi Song, Xi Wu arXiv_CV arXiv_CV Image_Caption Reinforcement_Learning Pose Action PDF
2021-12-14 ACE-BERT: Adversarial Cross-modal Enhanced BERT for E-commerce Retrieval Boxuan Zhang, Chao Wei, Yan Jin, Weiru Zhang arXiv_AI arXiv_AI Image_Caption Transformer Bert Adversarial Pose PDF
2021-12-13 VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks Yi-Lin Sung, Jaemin Cho, Mohit Bansal arXiv_AI arXiv_AI Image_Caption Transfer_Learning Knowledge Pose VQA Caption Language_Model QA PDF
2021-12-13 MAGIC: Multimodal relAtional Graph adversarIal inferenCe for Diverse and Unpaired Text-based Image Captioning Wenqiao Zhang, Haochen Shi, Jiannan Guo, Shengyu Zhang, Qingpeng Cai, Juncheng Li, Sihui Luo, Yueting Zhuang arXiv_AI arXiv_AI Image_Caption Adversarial Pose Relation Caption Inference PDF
2021-12-13 SphereSR Youngho Yoon, Inchul Chung, Lin Wang, Kuk-Jin Yoon arXiv_CV arXiv_CV Image_Caption Super_Resolution Pose Face Action Attention PDF
2021-12-10 Enhancing Multi-Scale Implicit Learning in Image Super-Resolution with Integrated Positional Encoding Ying-Tian Liu, Yuan-Chen Guo, Song-Hai Zhang arXiv_CV arXiv_CV Image_Caption Super_Resolution Pose Quantitative PDF
2021-12-09 Injecting Semantic Concepts into End-to-End Image Captioning Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lin Liang, Zhe Gan, Lijuan Wang, Yezhou Yang, Zicheng Liu arXiv_CV arXiv_CV Image_Caption Transformer Pose Classification Detection Object_Detection Caption Inference PDF
2021-12-09 Self-Supervised Image-to-Text and Text-to-Image Synthesis Anindya Sundar Das, Sriparna Saha arXiv_CV arXiv_CV Image_Caption Embedding RNN Self-Supervised Pose Quantitative Deep_Learning Relation GAN Text_Generation PDF
2021-12-08 Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Lavinia Dunagan, Jacob Morrison, Alexander R. Fabbri, Yejin Choi, Noah A. Smith arXiv_CL arXiv_CL Image_Caption Pose Relation Summarization Caption PDF
2021-12-07 Parallel Discrete Convolutions on Adaptive Particle Representations of Images Joel Jonsson, Bevan L. Cheeseman, Suryanarayana Maddu, Krzysztof Gonciarz, Ivo F. Sbalzarini arXiv_CV arXiv_CV Image_Caption Sparse PDF
2021-12-06 Embedding Arithmetic for Text-driven Image Transformation Guillaume Couairon, Matthieu Cord, Matthijs Douze, Holger Schwenk arXiv_CV arXiv_CV Image_Caption Embedding Relation Matching PDF
2021-12-06 Real-time Registration and Reconstruction with Cylindrical LiDAR Images Wei Dong, Kwonyoung Ryu, Michael Kaess, Jaesik Park arXiv_CV arXiv_CV Image_Caption Reconstruction Point_Cloud 3D Pose PDF
2021-12-05 Protecting Intellectual Property of Language Generation APIs with Lexical Watermark Xuanli He, Qiongkai Xu, Lingjuan Lyu, Fangzhao Wu, Chenguang Wang arXiv_CL arXiv_CL Image_Caption Pose Action Summarization Text_Generation Caption PDF
2021-12-02 Learning the semantic structure of objects from Web supervision David Novotny, Diane Larlus, Andrea Vedaldi arXiv_CV arXiv_CV Image_Caption Embedding Pose Relation PDF
2021-12-02 Consensus Graph Representation Learning for Better Grounded Image Captioning Wenqiao Zhang, Haochen Shi, Siliang Tang, Jun Xiao, Qiang Yu, Yueting Zhuang arXiv_AI arXiv_AI Image_Caption Represenation_Learning Pose Classification Caption PDF
2021-12-02 Object-Centric Unsupervised Image Captioning Zihang Meng, David Yang, Xuefei Cao, Ashish Shah, Ser-Nam Lim arXiv_AI arXiv_AI Image_Caption Transformer Unsupervised Relation Caption PDF
2021-12-01 On-Device Spatial Attention based Sequence Learning Approach for Scene Text Script Identification Rutika Moharir, Arun D Prabhu, Sukumar Moharana, Gopi Ramena, Rachit S Munjal arXiv_CV arXiv_CV Image_Caption OCR RNN Scene_Text Classification Attention CNN Inference PDF
2021-12-01 Translation-equivariant Image Quantizer for Bi-directional Image-Text Generation Woncheol Shin, Gyubok Lee, Jiyoung Lee, Joonseok Lee, Edward Choi arXiv_CV arXiv_CV Image_Caption Embedding Pose GAN Text_Generation PDF
2021-11-30 Open-Domain, Content-based, Multi-modal Fact-checking of Out-of-Context Images via Online Resources Sahar Abdelnabi, Rakibul Hasan, Mario Fritz arXiv_CV arXiv_CV Image_Caption OCR Pose Caption PDF
2021-11-29 Neural Attention for Image Captioning: Review of Outstanding Methods Zanyar Zohourianshahzadi, Jugal K. Kalita arXiv_CV arXiv_CV Image_Caption Review Survey Deep_Learning Attention Caption PDF
2021-11-29 Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic Yoad Tewel, Yoav Shalev, Idan Schwartz, Lior Wolf arXiv_AI arXiv_AI Image_Caption Zero-Shot Knowledge Pose Contrastive_Learning Text_Generation Caption Inference Language_Model Matching PDF
2021-11-28 Learning To Segment Dominant Object Motion From Watching Videos Sahir Shrestha, Mohammad Ali Armin, Hongdong Li, Nick Barnes arXiv_CV arXiv_CV Image_Caption Segmentation Unsupervised Salient Deep_Learning Optical_Flow Inference PDF
2021-11-25 Scene Graph Generation with Geometric Context Vishal Kumar, Albert Mundu, Satish Kumar Singh arXiv_AI arXiv_AI Image_Caption Recognition Knowledge Relation VQA Attention Caption Activity PDF
2021-11-24 Universal Captioner: Long-Tail Vision-and-Language Model Training through Content-Style Separation Marcella Cornia, Lorenzo Baraldi, Giuseppe Fiameni, Rita Cucchiara arXiv_AI arXiv_AI Image_Caption Zero-Shot Pose Caption Language_Model PDF
2021-11-24 Utilizing Resource-Rich Language Datasets for End-to-End Scene Text Recognition in Resource-Poor Languages Shota Orihashi, Yoshihiro Yamazaki, Naoki Makishima, Mana Ihori, Akihiko Takashima, Tomohiro Tanaka, Ryo Masumura arXiv_CV arXiv_CV Image_Caption Transformer Recognition Knowledge Pose Scene_Text PDF
2021-11-24 Scaling Up Vision-Language Pre-training for Image Captioning Xiaowei Hu, Zhe Gan, Jianfeng Wang, Zhengyuan Yang, Zicheng Liu, Yumao Lu, Lijuan Wang arXiv_CV arXiv_CV Image_Caption Transformer Zero-Shot Caption PDF
2021-11-23 Crossing the Format Boundary of Text and Boxes: Towards Unified Vision-Language Modeling Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang arXiv_CV arXiv_CV Image_Caption Transformer Pose VQA Text_Generation Caption Language_Model Prediction PDF
2021-11-22 Florence: A New Foundation Model for Computer Vision Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang arXiv_AI arXiv_AI Image_Caption Transfer_Learning Recognition Zero-Shot Pose Action_Recognition Action Classification Detection VQA Few-Shot Object_Detection Caption QA Video_Retrieval PDF
2021-11-22 L-Verse: Bidirectional Generation Between Image and Text Taehoon Kim, Gwangmo Song, Sihaeng Lee, Sangyun Kim, Yewon Seo, Soonyoung Lee, Seung Hwan Kim, Honglak Lee, Kyunghoon Bae arXiv_CV arXiv_CV Image_Caption Transformer Reconstruction Represenation_Learning Pose Action Quantitative Detection Relation Object_Detection Text_Generation Caption PDF
2021-11-20 Are Vision Transformers Robust to Patch Perturbations? Jindong Gu, Volker Tresp, Yao Qin arXiv_CV arXiv_CV Image_Caption Transformer Adversarial Quantitative Classification Attention CNN Image_Classification PDF
2021-11-19 UFO: A UniFied TransfOrmer for Vision-Language Representation Learning Jianfeng Wang, Xiaowei Hu, Zhe Gan, Zhengyuan Yang, Xiyang Dai, Zicheng Liu, Yumao Lu, Lijuan Wang arXiv_CV arXiv_CV Image_Caption Transformer Optimization Represenation_Learning Pose VQA Attention Caption Language_Model Matching PDF
2021-11-18 ClipCap: CLIP Prefix for Image Captioning Ron Mokady, Amir Hertz, Amit H. Bermano arXiv_CV arXiv_CV Image_Caption Pose Quantitative Caption Language_Model PDF
2021-11-17 Transparent Human Evaluation for Image Captioning Jungo Kasai, Keisuke Sakaguchi, Lavinia Dunagan, Jacob Morrison, Ronan Le Bras, Yejin Choi, Noah A. Smith arXiv_CV arXiv_CV Image_Caption Salient Caption PDF
2021-11-11 Unsupervised Part Discovery from Contrastive Reconstruction Subhabrata Choudhury, Iro Laina, Christian Rupprecht, Andrea Vedaldi arXiv_CV arXiv_CV Image_Caption Reconstruction Segmentation Unsupervised Represenation_Learning Self-Supervised Pose Classification Attention PDF
2021-11-10 Automated Pulmonary Embolism Detection from CTPA Images Using an End-to-End Convolutional Neural Network Yi Lin, Jianchao Su, Xiang Wang, Xiang Li, Jingen Liu, Kwang-Ting Cheng, Xin Yang arXiv_CV arXiv_CV Image_Caption 3D Pose Classification Detection CNN PDF
2021-11-07 Machine-in-the-Loop Rewriting for Creative Image Captioning Vishakh Padmakumar, He He arXiv_CL arXiv_CL Image_Caption Caption Language_Model PDF
2021-11-05 The Curious Layperson: Fine-Grained Image Recognition without Expert Labels Subhabrata Choudhury, Iro Laina, Christian Rupprecht, Andrea Vedaldi arXiv_CV arXiv_CV Image_Caption Recognition Knowledge PDF
2021-11-04 Generalized Radiograph Representation Learning via Cross-supervision between Images and Free-text Radiology Reports Hong-Yu Zhou, Xiaoyu Chen, Yinghao Zhang, Ruibang Luo, Liansheng Wang, Yizhou Yu arXiv_CV arXiv_CV Image_Caption Transformer Transfer_Learning Represenation_Learning Review Self-Supervised Pose Deep_Learning PDF
2021-10-26 Directional Self-supervised Learning for Risky Image Augmentations Yalong Bai, Yifan Yang, Wei Zhang, Tao Mei arXiv_CV arXiv_CV Image_Caption Represenation_Learning Self-Supervised Pose Relation PDF
2021-10-24 Bangla Image Caption Generation through CNN-Transformer based Encoder-Decoder Network Md Aminul Haque Palash, MD Abdullah Al Nasim, Sourav Saha, Faria Afrin, Raisa Mallik, Sathishkumar Samiappan arXiv_CV arXiv_CV Image_Caption Transformer Pose Action Attention Caption PDF
2021-10-22 Exploiting Cross-Modal Prediction and Relation Consistency for Semi-Supervised Image Captioning Yang Yang, Hongchen Wei, Hengshu Zhu, Dianhai Yu, Hui Xiong, Qingshan Liu, Jian Yang arXiv_AI arXiv_AI Image_Caption Embedding Knowledge Pose Relation Caption Prediction PDF
2021-10-20 A Self-Explainable Stylish Image Captioning Framework via Multi-References Chengxi Li, Brent Harrison arXiv_CL arXiv_CL Image_Caption Multi_Modal Pose Caption PDF
2021-10-20 NOD: Taking a Closer Look at Detection under Extreme Low-Light Conditions with Night Object Detection Dataset Igor Morawski, Yu-An Chen, Yu-Sheng Lin, Winston H. Hsu arXiv_CV arXiv_CV Image_Caption Enhancement Pose Image_Enhancement Detection Object_Detection Attention PDF
2021-10-19 Open-domain clarification question generation without question examples Julia White, Gabriel Poesia, Robert Hawkins, Dorsa Sadigh, Noah Goodman arXiv_CL arXiv_CL Image_Caption Pose Caption PDF
2021-10-19 Unifying Multimodal Transformer for Bi-directional Image and Text Generation Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu arXiv_CV arXiv_CV Image_Caption Transformer Pose Action Text_Generation PDF
2021-10-18 Learning multiplane images from single views with self-supervision Gustavo Sutter P. Carvalho, Diogo C. Luvizon, Antonio Joia, Andre G. C. Pacheco, Otavio A. B. Penatti arXiv_CV arXiv_CV Image_Caption Zero-Shot PDF
2021-10-17 Contrastive Learning of Visual-Semantic Embeddings Anurag Jain, Yashaswi Verma arXiv_CV arXiv_CV Image_Caption Embedding Image_Retrieval Pose Contrastive_Learning Classification Image_Classification PDF
2021-10-16 A Good Prompt Is Worth Millions of Parameters? Low-resource Prompt-based Learning for Vision-Language Models Woojeong Jin, Yu Cheng, Yelong Shen, Weizhu Chen, Xiang Ren arXiv_CV arXiv_CV Image_Caption Transformer Zero-Shot Pose VQA Few-Shot GAN Caption Inference Language_Model QA PDF
2021-10-16 Self-Annotated Training for Controllable Image Captioning Zhangzi Zhu, Tianlei Wang, Hong Qu arXiv_AI arXiv_AI Image_Caption Transformer Pose Caption Matching PDF
2021-10-15 Gait-based Frailty Assessment using Image Representation of IMU Signals and Deep CNN Muhammad Zeeshan Arshad, Dawoon Jung, Mina Park, Hyungeun Shin, Jinwook Kim, Kyung-Ryoul Mun arXiv_CV arXiv_CV Image_Caption Pose Classification Deep_Learning Activity PDF
2021-10-14 Automatic Modeling of Social Concepts Evoked by Art Images as Multimodal Frames Delfina Sol Martinez Pandiani, Valentina Presutti arXiv_CV arXiv_CV Image_Caption Pose Ontology Action Detection PDF
2021-10-13 Benchmarking the Robustness of Spatial-Temporal Models Against Corruptions Chenyu Yi, SIYUAN YANG, Haoliang Li, Yap-peng Tan, Alex Kot arXiv_CV arXiv_CV Image_Caption Transformer Video_Caption PDF
2021-10-12 Robust Glare Detection: Review, Analysis, and Dataset Release Mahdi Abolfazli Esfahani, Han Wang arXiv_AI arXiv_AI Image_Caption Review Pose Face Action Detection Autonomous PDF
2021-10-12 Topic Scene Graph Generation by Attention Distillation from Caption W. Wang, R. Wang, X. Chen arXiv_CV arXiv_CV Image_Caption Relation Attention Caption PDF
2021-10-11 Semi-Autoregressive Image Captioning Xu Yan, Zhengcong Fei, Zekang Li, Shuhui Wang, Qingming Huang, Qi Tian arXiv_CV arXiv_CV Image_Caption Knowledge Pose Caption Inference PDF
2021-10-10 Can Audio Captions Be Evaluated with Image Caption Metrics? Zelin Zhou, Zhiling Zhang, Xuenan Xu, Zeyu Xie, Mengyue Wu, Kenny Q. Zhu arXiv_CL arXiv_CL Image_Caption Bert Pose Detection Relation Object_Detection Caption PDF
2021-10-09 Deep Long-Tailed Learning: A Survey Yifan Zhang, Bingyi Kang, Bryan Hooi, Shuicheng Yan, Jiashi Feng arXiv_CV arXiv_CV Image_Caption Recognition Review Pose Survey Deep_Learning PDF
2021-10-09 Focus Your Distribution: Coarse-to-Fine Non-Contrastive Learning for Anomaly Detection and Localization Ye Zheng, Xiang Wang, Rui Deng, Tianpeng Bao, Rui Zhao, Liwei Wu arXiv_AI arXiv_AI Image_Caption Unsupervised Pose Contrastive_Learning Detection PDF
2021-10-07 Scale Invariant Domain Generalization Image Recapture Detection Jinian Luo, Jie Guo, Weidong Qiu, Zheng Huang, Hong Hui arXiv_CV arXiv_CV Image_Caption Regularization Adversarial Pose Face Detection Relation PDF
2021-10-07 InfoSeg: Unsupervised Semantic Image Segmentation with Mutual Information Maximization Robert Harb, Patrick Knöbelreiter arXiv_CV arXiv_CV Image_Caption Segmentation Unsupervised Represenation_Learning Self-Supervised Pose Quantitative PDF
2021-10-07 End-to-End Supermask Pruning: Learning to Prune Image Captioning Models Jia Huei Tan, Chee Seng Chan, Joon Huang Chuah arXiv_CV arXiv_CV Image_Caption Transformer Sparse Pose Relation Attention Caption PDF
2021-10-06 Is An Image Worth Five Sentences? A New Look into Semantics for Image-Text Matching Ali Furkan Biten, Andres Mafla, Lluis Gomez, Dimosthenis Karatzas arXiv_AI arXiv_AI Image_Caption Embedding Pose Relation Caption Matching PDF
2021-10-04 Let there be a clock on the beach: Reducing Object Hallucination in Image Captioning Ali Furkan Biten, Lluis Gomez, Dimosthenis Karatzas arXiv_CV arXiv_CV Image_Caption Pose Caption PDF
2021-10-04 Learning Structural Representations for Recipe Generation and Food Retrieval Hao Wang, Guosheng Lin, Steven C. H. Hoi, Chunyan Miao arXiv_CV arXiv_CV Image_Caption Unsupervised Pose Caption PDF
2021-10-02 Implicit and Explicit Attention for Zero-Shot Learning Faisal Alamri, Anjan Dutta arXiv_CV arXiv_CV Image_Caption Transformer Zero-Shot Self-Supervised Pose Attention PDF
2021-10-01 Geometry Attention Transformer with Position-aware LSTMs for Image Captioning Chi Wang, Yulin Shen, Luping Ji arXiv_CV arXiv_CV Image_Caption Transformer RNN Pose Relation Attention Caption PDF
2021-09-29 Geometry-Entangled Visual Semantic Transformer for Image Captioning Ling Cheng, Wei Wei, Feida Zhu, Yong Liu, Chunyan Miao arXiv_CV arXiv_CV Image_Caption Transformer Pose Attention Caption PDF
2021-09-28 Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networks Benedikt Mersch, Xieyuanli Chen, Jens Behley, Cyrill Stachniss arXiv_RO arXiv_RO Image_Caption Tracking Point_Cloud 3D Self-Supervised Pose CNN Autonomous Prediction PDF
2021-09-28 Neural Dependency Coding inspired Multimodal Fusion Shiv Shankar arXiv_AI arXiv_AI Image_Caption Recognition Speech Emotion Sentiment Speech_Recognition Caption PDF
2021-09-28 CIDEr-R: Robust Consensus-based Image Description Evaluation Gabriel Oliveira dos Santos, Esther Luna Colombini, Sandra Avila arXiv_CV arXiv_CV Image_Caption Caption PDF
2021-09-26 PETA: Photo Albums Event Recognition using Transformers Attention Tamar Glaser, Emanuel Ben-Baruch, Gilad Sharir, Nadav Zamir, Asaf Noy, Lihi Zelnik-Manor arXiv_CV arXiv_CV Image_Caption Transformer Recognition RNN Pose Classification Attention PDF
2021-09-23 Scene Graph Generation for Better Image Captioning? Maximilian Mozes, Martin Schmitt, Vladimir Golkov, Hinrich Schütze, Daniel Cremers arXiv_CV arXiv_CV Image_Caption Detection Relation Visual_Relation Caption PDF
2021-09-22 Caption Enriched Samples for Improving Hateful Memes Detection Efrat Blaier, Itzik Malkiel, Lior Wolf arXiv_AI arXiv_AI Image_Caption Classification Detection Caption Language_Model PDF
2021-09-21 TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models Minghao Li, Tengchao Lv, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei arXiv_CV arXiv_CV Image_Caption Transformer Recognition OCR RNN Optical_Character Pose Text_Generation Language_Model PDF
2021-09-17 Cross Modification Attention Based Deliberation Model for Image Captioning Zheng Lian, Yanan Zhang, Haichang Li, Rui Wang, Xiaohui Hu arXiv_AI arXiv_AI Image_Caption Pose Attention Caption Prediction PDF
2021-09-16 Aesthetics and neural network image representations Romuald A. Janik arXiv_CV arXiv_CV Image_Caption GAN PDF
2021-09-16 Label-Attention Transformer with Geometrically Coherent Objects for Image Captioning Shikha Dubey, Farrukh Olimov, Muhammad Aasim Rafique, Joonmo Kim, Moongu Jeon arXiv_AI arXiv_AI Image_Caption Transformer Pose Quantitative Relation Attention Caption PDF
2021-09-15 Image Captioning for Effective Use of Language Models in Knowledge-Based Visual Question Answering Ander Salaberria, Gorka Azkune, Oier Lopez de Lacalle, Aitor Soroa, Eneko Agirre arXiv_AI arXiv_AI Image_Caption Knowledge Knowledge_Graph Pose VQA Caption Inference Language_Model QA PDF
2021-09-15 Uncertainty Quantification in Medical Image Segmentation with Multi-decoder U-Net Yanwu Yang, Xutao Guo, Yiwei Pan, Pengcheng Shi, Haiyan Lv, Ting Ma arXiv_AI arXiv_AI Image_Caption Segmentation Pose Medical Prediction PDF
2021-09-14 SafeAccess+: An Intelligent System to make Smart Home Safer and Americans with Disability Act Compliant Shahinur Alam arXiv_AI arXiv_AI Image_Caption Action Quantitative Activity PDF
2021-09-13 UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation Zhengkun Zhang, Xiaojun Meng, Yasheng Wang, Xin Jiang, Qun Liu, Zhenglu Yang arXiv_CL arXiv_CL Image_Caption Salient Knowledge Pose Summarization Text_Generation Caption PDF
2021-09-11 COSMic: A Coherence-Aware Generation Metric for Image Descriptions Mert İnan, Piyush Sharma, Baber Khalid, Radu Soricut, Matthew Stone, Malihe Alikhani arXiv_AI arXiv_AI Image_Caption Bert Pose Relation Text_Generation Caption PDF
2021-09-11 Bornon: Bengali Image Captioning with Transformer-based Deep learning approach Faisal Muhammad Shah, Mayeesha Humaira, Md Abidur Rahman Khan Jim, Amit Saha Ami, Shimul Paul arXiv_CV arXiv_CV Image_Caption Transformer RNN Deep_Learning Attention Caption PDF
2021-09-10 MURAL: Multimodal, Multitask Retrieval Across Languages Aashi Jain, Mandy Guo, Krishna Srinivasan, Ting Chen, Sneha Kudugunta, Chao Jia, Yinfei Yang, Jason Baldridge arXiv_AI arXiv_AI Image_Caption Zero-Shot Caption Matching PDF
2021-09-10 Partially-supervised novel object captioning leveraging context from paired data Shashank Bujimalla, Mahesh Subedar, Omesh Tickoo arXiv_CV arXiv_CV Image_Caption Pose Detection Object_Detection Caption PDF
2021-09-10 An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, Lijuan Wang arXiv_CV arXiv_CV Image_Caption Knowledge Pose VQA Few-Shot Caption Prediction QA PDF
2021-09-09 Towards Robust Cross-domain Image Understanding with Unsupervised Noise Removal Lei Zhu, Zhaojing Luo, Wei Wang, Meihui Zhang, Gang Chen, Kaiping Zheng arXiv_CV arXiv_CV Image_Caption Embedding Unsupervised Weakly_Supervised Knowledge Adversarial Pose Deep_Learning Medical PDF
2021-09-08 RefineCap: Concept-Aware Refinement for Image Captioning Yekun Chai, Shuo Jin, Junliang Xing arXiv_CL arXiv_CL Image_Caption Pose Caption Language_Model PDF
2021-09-08 Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models Jiaoda Li, Duygu Ataman, Rico Sennrich arXiv_CL arXiv_CL Image_Caption Pose NMT Caption PDF
2021-09-07 Journalistic Guidelines Aware News Image Captioning Xuewen Yang, Svebor Karaman, Joel Tetreault, Alex Jaimes arXiv_CV arXiv_CV Image_Caption Pose GAN Caption PDF
2021-09-06 Zero-Shot Open Set Detection by Extending CLIP Sepideh Esmaeilpour, Bing Liu, Eric Robertson, Lei Shu arXiv_CV arXiv_CV Image_Caption Zero-Shot Represenation_Learning Pose Classification Detection PDF
2021-09-06 Visual Recognition with Deep Learning from Biased Image Datasets Robin Vogel, Stephan Clémençon, Pierre Laforgue arXiv_CV arXiv_CV Image_Caption Recognition Knowledge Pose Deep_Learning Prediction PDF
2021-09-06 Self-supervised Product Quantization for Deep Unsupervised Image Retrieval Young Kyun Jang, Nam Ik Cho arXiv_CV arXiv_CV Image_Caption Unsupervised Quantization Image_Retrieval Self-Supervised Pose Contrastive_Learning Deep_Learning PDF
2021-09-06 GeneAnnotator: A Semi-automatic Annotation Tool for Visual Scene Graph Zhixuan Zhang, Chi Zhang, Zhenning Niu, Le Wang, Yuehu Liu arXiv_CV arXiv_CV Image_Caption Pose Relation VQA Visual_Relation Caption QA PDF
2021-09-05 Sparse-MLP: A Fully-MLP Architecture with Conditional Computation Yuxuan Lou, Fuzhao Xue, Zangwei Zheng, Yang You arXiv_AI arXiv_AI Image_Caption Sparse Pose Classification Attention Image_Classification PDF
2021-09-04 LAViTeR: Learning Aligned Visual and Textual Representations Assisted by Image and Caption Generation Mohammad Abuzar Shaikh, Zhanghexuan Ji, Dana Moukheiber, Sargur Srihari, Mingchen Gao arXiv_AI arXiv_AI Image_Caption Transformer Embedding Represenation_Learning Self-Supervised Pose Attention GAN Caption PDF
2021-09-03 IMG2SMI: Translating Molecular Structure Images to Simplified Molecular-input Line-entry System Daniel Campos, Heng Ji arXiv_CV arXiv_CV Image_Caption Transformer Unsupervised Recognition Action Caption Prediction PDF
2021-09-03 Multi-centred Strong Augmentation via Contrastive Learning for Unsupervised Lesion Detection and Segmentation Yu Tian, Fengbei Liu, Guansong Pang, Yuanhong Chen, Yuyuan Liu, Johan W. Verjans, Rajvinder Singh, Gustavo Carneiro arXiv_CV arXiv_CV Image_Caption Segmentation Unsupervised Self-Supervised Pose Contrastive_Learning Face Detection GAN Medical PDF
2021-09-02 VIbCReg: Variance-Invariance-better-Covariance Regularization for Self-Supervised Learning on Time Series Daesoo Lee (1), Erlend Aune (1 and 2) ((1) Norwegian University of Science and Technology, (2) BI Norwegian Business School) arXiv_AI arXiv_AI Image_Caption Regularization Self-Supervised Pose Classification PDF
2021-08-29 Zero-shot Natural Language Video Localization Jinwoo Nam, Daechul Ahn, Dongyeop Kang, Seong Jong Ha, Jonghyun Choi arXiv_AI arXiv_AI Image_Caption Unsupervised Zero-Shot Pose Detection Object_Detection Caption Activity PDF
2021-08-28 Goal-driven text descriptions for images Ruotian Luo arXiv_CV arXiv_CV Image_Caption Recognition Pose_Estimation Speech Pose Classification Deep_Learning Detection Object_Detection Speech_Recognition Caption Image_Classification Video_Classification PDF
2021-08-28 QACE: Asking Questions to Evaluate an Image Caption Hwanhee Lee, Thomas Scialom, Seunghyun Yoon, Franck Dernoncourt, Kyomin Jung arXiv_CV arXiv_CV Image_Caption Pose Classification VQA Caption QA PDF
2021-08-27 Automatic Text Evaluation through the Lens of Wasserstein Barycenters Pierre Colombo, Guillaume Staerman, Chloe Clavel, Pablo Piantanida arXiv_AI arXiv_AI Image_Caption Embedding Bert Summarization Text_Generation Caption PDF
2021-08-26 Similar Scenes arouse Similar Emotions: Parallel Data Augmentation for Stylized Image Captioning Guodun Li, Yuchen Zhai, Zehao Lin, Yin Zhang arXiv_CV arXiv_CV Image_Caption Unsupervised Pose Emotion Caption PDF
2021-08-26 Web Image Context Extraction with Graph Neural Networks and Sentence Embeddings on the DOM tree Chen Dang (QR), Hicham Randrianarivo (QR), Raphaël Fournier-S'Niehotta (CNAM, CEDRIC - VERTIGO), Nicolas Audebert (CNAM, CEDRIC - VERTIGO) arXiv_CV arXiv_CV Image_Caption Embedding Action Caption PDF
2021-08-25 Product-oriented Machine Translation with Cross-modal Cross-lingual Pre-training Yuqing Song, Shizhe Chen, Qin Jin, Wei Luo, Jun Xie, Fei Huang arXiv_CV arXiv_CV Image_Caption PDF
2021-08-24 SimVLM: Simple Visual Language Model Pretraining with Weak Supervision Zirui Wang, Jiahui Yu, Adams Wei Yu, Zihang Dai, Yulia Tsvetkov, Yuan Cao arXiv_CV arXiv_CV Image_Caption Zero-Shot VQA Caption Language_Model QA PDF
2021-08-24 A QuadTree Image Representation for Computational Pathology Rob Jewsbury, Abhir Bhalerao, Nasir Rajpoot arXiv_CV arXiv_CV Image_Caption Knowledge Action Classification CNN PDF
2021-08-24 Auto-Parsing Network for Image Captioning and Visual Question Answering Xu Yang, Chongyang Gao, Hanwang Zhang, Jianfei Cai arXiv_CV arXiv_CV Image_Caption Transformer Embedding Sparse Knowledge Pose VQA Attention Caption Inference PDF
2021-08-22 Relational Embedding for Few-Shot Classification Dahyun Kang, Heeseung Kwon, Juhong Min, Minsu Cho arXiv_CV arXiv_CV Image_Caption Embedding Pose Classification Relation Few-Shot Attention PDF
2021-08-20 Exploring Data Aggregation and Transformations to Generalize across Visual Domains Antono D'Innocente arXiv_CV arXiv_CV Image_Caption Pose Deep_Learning Detection Object_Detection CNN PDF
2021-08-20 Group-based Distinctive Image Captioning with Memory Attention Jiuniu Wang, Wenjia Xu, Qingzhong Wang, Antoni B. Chan arXiv_CV arXiv_CV Image_Caption Pose Contrastive_Learning Quantitative Relation Attention Caption PDF
2021-08-20 Airbert: In-domain Pretraining for Vision-and-Language Navigation Pierre-Louis Guhur, Makarand Tapaswi, Shizhe Chen, Ivan Laptev, Cordelia Schmid arXiv_AI arXiv_AI Image_Caption Bert Pose Few-Shot Caption PDF
2021-08-19 ImageBART: Bidirectional Context with Multinomial Diffusion for Autoregressive Image Synthesis Patrick Esser, Robin Rombach, Andreas Blattmann, Björn Ommer arXiv_CV arXiv_CV Image_Caption Inpainting Attention PDF
2021-08-18 Revisiting Binary Local Image Description for Resource Limited Devices Iago Suárez, José M. Buenaposada, Luis Baumela arXiv_CV arXiv_CV Image_Caption Pose Deep_Learning PDF
2021-08-18 X-modaler: A Versatile and High-performance Codebase for Cross-modal Analytics Yehao Li, Yingwei Pan, Jingwen Chen, Ting Yao, Tao Mei arXiv_AI arXiv_AI Image_Caption Video_Caption Pose Action Deep_Learning VQA Caption PDF
2021-08-18 Thermal Image Processing via Physics-Inspired Deep Networks Vishwanath Saragadam, Akshat Dave, Ashok Veeraraghavan, Richard Baraniuk arXiv_CV arXiv_CV Image_Caption Super_Resolution Denoising PDF
2021-08-17 VisBuddy -- A Smart Wearable Assistant for the Visually Challenged Ishwarya Sivakumar, Nishaali Meenakshisundaram, Ishwarya Ramesh, Shiloah Elizabeth D, Sunil Retmin Raj C arXiv_CV arXiv_CV Image_Caption Recognition OCR Optical_Character Knowledge Pose Face Action Deep_Learning Detection Object_Detection Caption PDF
2021-08-16 Who's Waldo? Linking People Across Text and Images Claire Yuqing Cui, Apoorv Khandelwal, Yoav Artzi, Noah Snavely, Hadar Averbuch-Elor arXiv_CV arXiv_CV Image_Caption Transformer Pose Action Caption PDF
2021-08-13 Detection and Captioning with Unseen Object Classes Berkan Demirel, Ramazan Gokberk Cinbis arXiv_CV arXiv_CV Image_Caption Recognition Zero-Shot Pose Detection Caption Language_Model PDF
2021-08-12 MUSIQ: Multi-scale Image Quality Transformer Junjie Ke, Qifei Wang, Yilin Wang, Peyman Milanfar, Feng Yang arXiv_CV arXiv_CV Image_Caption Transformer Embedding Pose CNN QA PDF
2021-08-12 TVT: Transferable Vision Transformer for Unsupervised Domain Adaptation Jinyu Yang, Jingjing Liu, Ning Xu, Junzhou Huang arXiv_CV arXiv_CV Image_Caption Transformer Unsupervised Knowledge Adversarial Pose Attention CNN PDF
2021-08-12 Towers of Babel: Combining Images, Language, and 3D Geometry for Learning Multimodal Vision Xiaoshi Wu, Hadar Averbuch-Elor, Jin Sun, Noah Snavely arXiv_CV arXiv_CV Image_Caption Reconstruction 3D Caption PDF
2021-08-08 OVIS: Open-Vocabulary Visual Instance Search via Visual-Semantic Aligned Representation Learning Sheng Liu, Kevin Lin, Lijuan Wang, Junsong Yuan, Zicheng Liu arXiv_AI arXiv_AI Image_Caption Represenation_Learning Pose Caption PDF
2021-08-06 Ensemble Augmentation for Deep Neural Networks Using 1-D Time Series Vibration Data Atik Faysal, Ngui Wai Keng, M. H. Lim arXiv_AI arXiv_AI Image_Caption Transfer_Learning Adversarial Pose Classification GAN PDF
2021-08-06 DOLG: Single-Stage Image Retrieval with Deep Orthogonal Fusion of Local and Global Features Min Yang, Dongliang He, Miao Fan, Baorong Shi, Xuetong Xue, Fu Li, Errui Ding, Jizhou Huang arXiv_CV arXiv_CV Image_Caption Represenation_Learning Image_Retrieval Pose Attention PDF
2021-08-06 Interpretable Visual Understanding with Cognitive Attention Network Xuejiao Tang, Wenbin Zhang, Yi Yu, Kea Turner, Tyler Derr, Mengyu Wang, Eirini Ntoutsi arXiv_AI arXiv_AI Image_Caption Recognition Knowledge Pose Attention Inference PDF
2021-08-05 Neural Twins Talk & Alternative Calculations Zanyar Zohourianshahzadi, Jugal K. Kalita arXiv_CV arXiv_CV Image_Caption Medical Caption PDF
2021-08-05 Video Contrastive Learning with Global Context Haofei Kuang, Yi Zhu, Zhi Zhang, Xinyu Li, Joseph Tighe, Sören Schwertfeger, Cyrill Stachniss, Mu Li arXiv_AI arXiv_AI Image_Caption Represenation_Learning Regularization Self-Supervised Action_Localization Pose Contrastive_Learning Action Classification Video_Retrieval PDF
2021-08-05 Global and Local Texture Randomization for Synthetic-to-Real Semantic Segmentation Duo Peng, Yinjie Lei, Lingqiao Liu, Pingping Zhang, Jun Liu arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation Regularization Pose CNN PDF
2021-08-05 Dual Graph Convolutional Networks with Transformer and Curriculum Learning for Image Captioning Xinzhi Dong, Chengjiang Long, Wenju Xu, Chunxia Xiao arXiv_CV arXiv_CV Image_Caption Transformer Review Pose Relation Caption CNN PDF
2021-08-05 O2NA: An Object-Oriented Non-Autoregressive Approach for Controllable Video Captioning Fenglin Liu, Xuancheng Ren, Xian Wu, Bang Yang, Shen Ge, Xu Sun arXiv_CV arXiv_CV Image_Caption Video_Caption Pose Relation Caption Inference PDF
2021-08-04 Question-controlled Text-aware Image Captioning Anwen Hu, Shizhe Chen, Qin Jin arXiv_CV arXiv_CV Image_Caption Pose Scene_Text Relation Caption QA PDF
2021-08-04 ICECAP: Information Concentrated Entity-aware Image Captioning Anwen Hu, Shizhe Chen, Qin Jin arXiv_CV arXiv_CV Image_Caption Knowledge Pose Caption PDF
2021-08-02 Neural Image Representations for Multi-Image Fusion and Layer Separation Seonghyeon Nam, Marcus A. Brubaker, Michael S. Brown arXiv_CV arXiv_CV Image_Caption Pose Optical_Flow PDF
2021-08-02 Distributed Attention for Grounded Image Captioning Nenglun Chen, Xingjia Pan, Runnan Chen, Lei Yang, Zhiwen Lin, Yuqiang Ren, Haolei Yuan, Xiaowei Guo, Feiyue Huang, Wenping Wang arXiv_CV arXiv_CV Image_Caption Weakly_Supervised Regularization Pose Attention Caption PDF
2021-08-02 GraphFPN: Graph Feature Pyramid Network for Object Detection Gangming Zhao, Weifeng Ge, Yizhou Yu arXiv_CV arXiv_CV Image_Caption Pose Action Detection Object_Detection Attention CNN PDF
2021-07-30 Product1M: Towards Weakly Supervised Instance-Level Product Retrieval via Cross-modal Pretraining Xunlin Zhan, Yangxin Wu, Xiao Dong, Yunchao Wei, Minlong Lu, Yichi Zhang, Hang Xu, Xiaodan Liang arXiv_CV arXiv_CV Image_Caption Transformer Weakly_Supervised Self-Supervised Pose Caption PDF
2021-07-29 ReFormer: The Relational Transformer for Image Captioning Xuewen Yang, Yingru Liu, Xin Wang arXiv_CV arXiv_CV Image_Caption Transformer Pose Relation Caption CNN PDF
2021-07-28 A Thorough Review on Recent Deep Learning Methodologies for Image Captioning Ahmed Elhagry, Karima Kadaoui arXiv_CV arXiv_CV Image_Caption Knowledge Review Adversarial Deep_Learning Attention GAN Caption PDF
2021-07-28 Experimenting with Self-Supervision using Rotation Prediction for Image Captioning Ahmed Elhagry, Karima Kadaoui arXiv_CV arXiv_CV Image_Caption Recognition RNN Self-Supervised Medical Caption CNN Prediction PDF
2021-07-27 Image Scene Graph Generation Benchmark Xiaotian Han, Jianwei Yang, Houdong Hu, Lei Zhang, Jianfeng Gao, Pengchuan Zhang arXiv_CV arXiv_CV Image_Caption Detection Relation Object_Detection Visual_Relation PDF
2021-07-26 Boosting Entity-aware Image Captioning with Multi-modal Knowledge Graph Wentian Zhao, Yao Hu, Heda Wang, Xinxiao Wu, Jiebo Luo arXiv_CV arXiv_CV Image_Caption Knowledge Knowledge_Graph Pose Relation Attention Caption Matching PDF
2021-07-24 Hand Image Understanding via Deep Multi-Task Learning Zhang Xiong, Huang Hongsheng, Tan Jianchao, Xu Hongmin, Yang Cheng, Peng Guozhu, Wang Lei, Liu Ji arXiv_CV arXiv_CV Image_Caption Reconstruction Segmentation 3D Pose_Estimation Self-Supervised Pose Quantitative Relation PDF
2021-07-23 Image-to-Image Translation with Low Resolution Conditioning Mohamed Abderrahmen Abid, Ihsen Hedhli, Jean-François Lalonde, Christian Gagne arXiv_CV arXiv_CV Image_Caption Pose Quantitative GAN PDF
2021-07-19 Compound Figure Separation of Biomedical Images with Side Loss Tianyuan Yao, Chang Qu, Quan Liu, Ruining Deng, Yuanhan Tian, Jiachen Xu, Aadarsh Jha, Shunxing Bao, Mengyang Zhao, Agnes B. Fogo, Bennett A.Landman, Catie Chang, Haichun Yang, Yuankai Huo arXiv_CV arXiv_CV Image_Caption Unsupervised Self-Supervised Pose Contrastive_Learning Classification Deep_Learning Detection Medical PDF
2021-07-16 All the attention you need: Global-local, spatial-channel attention for image retrieval Chull Hwan Song, Hye Joo Han, Yannis Avrithis arXiv_CV arXiv_CV Image_Caption Embedding Represenation_Learning Image_Retrieval Action Classification Detection Attention PDF
2021-07-16 Exploiting generative self-supervised learning for the assessment of biological images with lack of annotations: a COVID-19 case-study Alessio Mascolini, Dario Cardamone, Francesco Ponzio, Santa Di Cataldo, Elisa Ficarra arXiv_CV arXiv_CV Image_Caption Zero-Shot Represenation_Learning Adversarial Self-Supervised Classification Deep_Learning GAN PDF
2021-07-14 From Show to Tell: A Survey on Image Captioning Matteo Stefanini, Marcella Cornia, Lorenzo Baraldi, Silvia Cascianelli, Giuseppe Fiameni, Rita Cucchiara arXiv_CV arXiv_CV Image_Caption Bert Pose Survey Quantitative Relation Text_Generation Caption Language_Model PDF
2021-07-13 How Much Can CLIP Benefit Vision-and-Language Tasks? Sheng Shen, Liunian Harold Li, Hao Tan, Mohit Bansal, Anna Rohrbach, Kai-Wei Chang, Zhewei Yao, Kurt Keutzer arXiv_AI arXiv_AI Image_Caption Zero-Shot Pose VQA Caption PDF
2021-07-08 Deep Learning Based Image Retrieval in the JPEG Compressed Domain Shrikant Temburwar, Bulla Rajesh, Mohammed Javed arXiv_CV arXiv_CV Image_Caption Image_Retrieval Pose Action Deep_Learning PDF
2021-07-07 Controlled Caption Generation for Images Through Adversarial Attacks Nayyer Aafaq, Naveed Akhtar, Wei Liu, Mubarak Shah, Ajmal Mian arXiv_CV arXiv_CV Image_Caption RNN Adversarial Pose Action Classification Deep_Learning GAN Caption CNN Language_Model PDF
2021-07-06 Independent Encoder for Deep Hierarchical Unsupervised Image-to-Image Translation Kai Ye, Yinru Ye, Minqiang Yang, Bin Hu arXiv_CV arXiv_CV Image_Caption Unsupervised Pose GAN PDF
2021-07-01 Egocentric Image Captioning for Privacy-Preserved Passive Dietary Intake Monitoring Jianing Qiu, Frank P.-W. Lo, Xiao Gu, Modou L. Jobarteh, Wenyan Jia, Tom Baranowski, Matilda Steiner-Asiedu, Alex K. Anderson, Megan A McCrory, Edward Sazonov, Mingui Sun, Gary Frost, Benny Lo arXiv_CV arXiv_CV Image_Caption Transformer Recognition Knowledge Pose Caption PDF
2021-06-29 Evaluation of Automated Image Descriptions for Visually Impaired Students Anett Hoppe, David Morris, Ralph Ewerth arXiv_CV arXiv_CV Image_Caption PDF
2021-06-29 Contrastive Semantic Similarity Learning for Image Captioning Evaluation with Intrinsic Auto-encoder Chao Zeng, Tiesong Zhao, Sam Kwong arXiv_CV arXiv_CV Image_Caption Represenation_Learning Pose Caption Matching PDF
2021-06-29 AutoNovel: Automatically Discovering and Learning Novel Visual Categories Kai Han, Sylvestre-Alvise Rebuffi, Sébastien Ehrhardt, Andrea Vedaldi, Andrew Zisserman arXiv_CV arXiv_CV Image_Caption Unsupervised Knowledge Self-Supervised Pose Classification PDF
2021-06-26 UMIC: An Unreferenced Metric for Image Captioning via Contrastive Learning Hwanhee Lee, Seunghyun Yoon, Franck Dernoncourt, Trung Bui, Kyomin Jung arXiv_CV arXiv_CV Image_Caption Bert Contrastive_Learning Relation Text_Generation Caption PDF
2021-06-25 Probing Inter-modality: Visual Parsing with Self-Attention for Vision-Language Pre-training Hongwei Xue, Yupan Huang, Bei Liu, Houwen Peng, Jianlong Fu, Houqiang Li, Jiebo Luo arXiv_CV arXiv_CV Image_Caption Transformer Embedding Optimization Knowledge Pose Action Relation VQA Attention Visual_Relation QA PDF
2021-06-25 A Picture May Be Worth a Hundred Words for Visual Question Answering Yusuke Hirota, Noa Garcia, Mayu Otani, Chenhui Chu, Yuta Nakashima, Ittetsu Taniguchi, Takao Onoye arXiv_CV arXiv_CV Image_Caption Transformer Pose VQA Language_Model QA PDF
2021-06-23 Neural Fashion Image Captioning : Accounting for Data Diversity Gilles Hacheme, Noureini Sayouti arXiv_AI arXiv_AI Image_Caption Transfer_Learning RNN Caption PDF
2021-06-22 Multi-layered Semantic Representation Network for Multi-label Image Classification Xiwen Qu, Hao Che, Jun Huang, Linchuan Xu, Xiao Zheng arXiv_AI arXiv_AI Image_Caption Pose Classification Relation Attention CNN Image_Classification PDF
2021-06-21 Attention-based cross-modal fusion for audio-visual voice activity detection in musical video streams Yuanbo Hou, Zhesong Yu, Xia Liang, Xingjian Du, Bilei Zhu, Zejun Ma, Dick Botteldooren arXiv_SD arXiv_SD Image_Caption Speech Pose Detection Relation Attention Activity PDF
2021-06-21 Visual Probing: Cognitive Framework for Explaining Self-Supervised Image Representations Witold Oleszkiewicz, Dominika Basaj, Igor Sieradzki, Michał Górszczak, Barbara Rychalska, Koryna Lewandowska, Tomasz Trzciński, Bartosz Zieliński arXiv_AI arXiv_AI Image_Caption Represenation_Learning Knowledge Self-Supervised Pose Relation PDF
2021-06-21 TCIC: Theme Concepts Learning Cross Language and Vision for Image Captioning Zhihao Fan, Zhongyu Wei, Siyuan Wang, Ruize Wang, Zejun Li, Haijun Shan, Xuanjing Huang arXiv_CV arXiv_CV Image_Caption Transformer Represenation_Learning Pose Relation Caption PDF
2021-06-21 Confidence-Guided Radiology Report Generation Yixin Wang, Zihao Lin, Jiang Tian, zhongchao shi, Yang Zhang, Jianping Fan, Zhiqiang He arXiv_CV arXiv_CV Image_Caption Optimization Pose Deep_Learning Medical Caption PDF
2021-06-20 Exploring Semantic Relationships for Unpaired Image Captioning Fenglin Liu, Meng Gao, Tianhao Zhang, Yuexian Zou arXiv_CV arXiv_CV Image_Caption Pose Relation Caption PDF
2021-06-17 Semi-Autoregressive Transformer for Image Captioning Yuanen Zhou, Yong Zhang, Zhenzhen Hu, Meng Wang arXiv_CV arXiv_CV Image_Caption Transformer Pose Caption Inference PDF
2021-06-16 Deformation Driven Seq2Seq Longitudinal Tumor and Organs-at-Risk Prediction for Radiotherapy Donghoon Lee, Sadegh R Alam, Jue Jiang, Pengpeng Zhang, Saad Nadeem, Yu-Chi Hu arXiv_CV arXiv_CV Image_Caption 3D Optimization RNN Pose Relation Contour GAN Prediction PDF
2021-06-16 Semantic sentence similarity: size does not always matter Danny Merkx, Stefan L. Frank, Mirjam Ernestus arXiv_CL arXiv_CL Image_Caption Embedding Recognition Knowledge Speech Speech_Recognition Caption PDF
2021-06-16 PatchNet: Unsupervised Object Discovery based on Patch Embedding Hankyu Moon, Heng Hao, Sima Didari, Jae Oh Woo, Patrick Bangert arXiv_AI arXiv_AI Image_Caption Embedding Unsupervised Salient Face Inference PDF
2021-06-16 Understanding and Evaluating Racial Biases in Image Captioning Dora Zhao, Angelina Wang, Olga Russakovsky arXiv_CV arXiv_CV Image_Caption Sentiment Caption PDF
2021-06-15 Self-Supervised Learning with Kernel Dependence Maximization Yazhe Li, Roman Pogodin, Danica J. Sutherland, Arthur Gretton arXiv_AI arXiv_AI Image_Caption Segmentation Semantic_Segmentation Recognition Bert Self-Supervised Classification PDF
2021-06-12 Contrastive Semi-Supervised Learning for 2D Medical Image Segmentation Prashant Pandey, Ajey Pai, Nisarg Bhatt, Prasenjit Das, Govind Makharia, Prathosh AP, Mausam arXiv_CV arXiv_CV Image_Caption Segmentation Represenation_Learning Regularization Pose Contrastive_Learning Medical PDF
2021-06-10 Data augmentation to improve robustness of image captioning solutions Shashank Bujimalla, Mahesh Subedar, Omesh Tickoo arXiv_CV arXiv_CV Image_Caption Detection Object_Detection Caption PDF
2021-06-09 Implicit field learning for unsupervised anomaly detection in medical images Sergio Naval Marimont, Giacomo Tarroni arXiv_CV arXiv_CV Image_Caption Unsupervised Restoration Pose Detection Medical Inference PDF
2021-06-07 Counterfactual Maximum Likelihood Estimation for Training Deep Networks Xinyi Wang, Wenhu Chen, Michael Saxon, William Yang Wang arXiv_CL arXiv_CL Image_Caption Pose Deep_Learning Relation Caption Inference Prediction PDF
2021-06-07 BERTGEN: Multi-task Generation through BERT Faidon Mitzalis, Ozan Caglayan, Pranava Madhyastha, Lucia Specia arXiv_CL arXiv_CL Image_Caption Bert Zero-Shot Caption PDF
2021-06-07 SelfDoc: Self-Supervised Document Representation Learning Peizhao Li, Jiuxiang Gu, Jason Kuen, Vlad I. Morariu, Handong Zhao, Rajiv Jain, Varun Manjunatha, Hongfu Liu arXiv_CV arXiv_CV Image_Caption Represenation_Learning Self-Supervised Pose Attention PDF
2021-06-03 E2E-VLP: End-to-End Vision-Language Pre-training Enhanced by Visual Learning Haiyang Xu, Ming Yan, Chenliang Li, Bin Bi, Songfang Huang, Wenming Xiao, Fei Huang arXiv_AI arXiv_AI Image_Caption Transformer Embedding Pose Face Detection Object_Detection Caption PDF
2021-06-03 SSMD: Semi-Supervised Medical Image Detection with Adaptive Consistency and Heterogeneous Perturbation Hong-Yu Zhou, Chengdi Wang, Haofeng Li, Gang Wang, Shu Zhang, Weimin Li, Yizhou Yu arXiv_CV arXiv_CV Image_Caption Segmentation Pose Classification Detection Object_Detection Attention Medical Prediction PDF
2021-06-02 Personalizing Pre-trained Models Mina Khan, P Srivatsa, Advait Rane, Shriram Chenniappa, Asadali Hazariwala, Pattie Maes arXiv_CV arXiv_CV Image_Caption Weakly_Supervised Represenation_Learning Self-Supervised Few-Shot PDF
2021-06-02 Learning to Select: A Fully Attentive Approach for Novel Object Captioning Marco Cagrandi, Marcella Cornia, Matteo Stefanini, Lorenzo Baraldi, Rita Cucchiara arXiv_CV arXiv_CV Image_Caption Caption Language_Model PDF
2021-06-01 A Novel Graph-Theoretic Deep Representation Learning Method for Multi-Label Remote Sensing Image Retrieval Gencer Sumbul, Begüm Demir arXiv_CV arXiv_CV Image_Caption Represenation_Learning Image_Retrieval Pose Relation GAN PDF
2021-06-01 Reconciliation of Statistical and Spatial Sparsity For Robust Image and Image-Set Classification Hao Cheng, Kim-Hui Yap, Bihan Wen arXiv_CV arXiv_CV Image_Caption Sparse Knowledge Pose Classification Image_Classification PDF
2021-05-30 Longer Version for 'Deep Context-Encoding Network for Retinal Image Captioning' Jia-Hong Huang, Ting-Wei Wu, Chao-Han Huck Yang, Marcel Worring arXiv_AI arXiv_AI Image_Caption Pose Medical Caption PDF
2021-05-28 New Image Captioning Encoder via Semantic Visual Feature Matching for Heavy Rain Images Chang-Hwan Son, Pung-Hwi Ye arXiv_CV arXiv_CV Image_Caption Reconstruction Pose Action Caption Matching PDF
2021-05-27 Blind Motion Deblurring Super-Resolution: When Dynamic Spatio-Temporal Learning Meets Static Image Understanding Wenjia Niu, Kaihao Zhang, Wenhan Luo, Yiran Zhong, Xin Yu, Hongdong Li arXiv_CV arXiv_CV Image_Caption Reconstruction Super_Resolution Pose PDF
2021-05-26 Computer Vision and Conflicting Values: Describing People with Automated Alt Text Margot Hanley, Solon Barocas, Karen Levy, Shiri Azenkot, Helen Nissenbaum arXiv_AI arXiv_AI Image_Caption Pose Face Attention PDF
2021-05-24 Multi-modal Understanding and Generation for Medical Images and Text via Vision-Language Pre-Training Jong Hak Moon, Hyungyung Lee, Woncheol Shin, Edward Choi arXiv_CV arXiv_CV Image_Caption Transformer Bert Represenation_Learning Pose Classification VQA Attention Medical Caption PDF
2021-05-24 StructuralLM: Structural Pre-training for Form Understanding Chenliang Li, Bin Bi, Ming Yan, Wei Wang, Songfang Huang, Fei Huang, Luo Si arXiv_CL arXiv_CL Image_Caption Pose Action Classification VQA Image_Classification Language_Model PDF
2021-05-23 Revisiting 2D Convolutional Neural Networks for Graph-based Applications Yecheng Lyu, Xinming Huang, Ziming Zhang arXiv_CV arXiv_CV Image_Caption Segmentation Point_Cloud 3D Optimization Pose Classification CNN PDF
2021-05-21 Visual representation of negation: Real world data analysis on comic image design Yuri Sato, Koji Mineshima, Kazuhiro Ueda arXiv_AI arXiv_AI Image_Caption Knowledge Classification Deep_Learning Caption Image_Classification PDF
2021-05-20 More Than Just Attention: Learning Cross-Modal Attentions with Contrastive Constraints Yuxiao Chen, Jianbo Yuan, Long Zhao, Rui Luo, Larry Davis, Dimitris N. Metaxas arXiv_CV arXiv_CV Image_Caption Pose Contrastive_Learning Quantitative Attention Caption Matching PDF
2021-05-18 Dependent Multi-Task Learning with Causal Intervention for Image Captioning Wenqing Chen, Jidong Tian, Caoyun Fan, Hao He, Yaohui Jin arXiv_CV arXiv_CV Image_Caption Reinforcement_Learning Pose Relation Caption PDF
2021-05-17 Multi-Modal Image Captioning for the Visually Impaired Hiba Ahsan, Nikita Bhalla, Daivat Bhatt, Kaivankumar Shah arXiv_CL arXiv_CL Image_Caption Pose Caption PDF
2021-05-16 Survey of Visual-Semantic Embedding Methods for Zero-Shot Image Retrieval Kazuya Ueki arXiv_CV arXiv_CV Image_Caption Embedding Zero-Shot Image_Retrieval Survey VQA Caption QA Matching PDF
2021-05-14 Empirical Analysis of Image Caption Generation using Deep Learning Aditya Bhattacharya, Eshwar Shamanna Girishekar, Padmakar Anil Deshpande arXiv_CV arXiv_CV Image_Caption Embedding RNN Deep_Learning Attention Caption PDF
2021-05-13 Contrastive Learning of Image Representations with Cross-Video Cycle-Consistency Haiping Wu, Xiaolong Wang arXiv_CV arXiv_CV Image_Caption Tracking Recognition Object_Tracking Represenation_Learning Self-Supervised Pose Contrastive_Learning Action_Recognition Action Classification Relation Image_Classification PDF
2021-05-13 High-Resolution Complex Scene Synthesis with Transformers Manuel Jahn, Robin Rombach, Björn Ommer arXiv_CV arXiv_CV Image_Caption Transformer Adversarial PDF
2021-05-12 Connecting What to Say With Where to Look by Modeling Human Attention Traces Zihang Meng, Licheng Yu, Ning Zhang, Tamara Berg, Babak Damavandi, Vikas Singh, Amy Bearman arXiv_CV arXiv_CV Image_Caption Pose Attention Caption Matching PDF
2021-05-12 A Large-Scale Benchmark for Food Image Segmentation Xiongwei Wu, Xin Fu, Ying Liu, Ee-Peng Lim, Steven C.H. Hoi, Qianru Sun arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Semantic_Segmentation Knowledge Pose PDF
2021-05-11 Instance-aware Remote Sensing Image Captioning with Cross-hierarchy Attention Chengze Wang, Zhiyu Jiang, Yuan Yuan arXiv_CV arXiv_CV Image_Caption Pose Action Attention Caption PDF
2021-05-11 VICReg: Variance-Invariance-Covariance Regularization for Self-Supervised Learning Adrien Bardes, Jean Ponce, Yann LeCun arXiv_AI arXiv_AI Image_Caption Embedding Represenation_Learning Regularization Self-Supervised Relation PDF
2021-05-10 T-EMDE: Sketching-based global similarity for cross-modal retrieval Barbara Rychalska, Mikolaj Wieczorek, Jacek Dabrowski arXiv_CV arXiv_CV Image_Caption Embedding Sketch Pose Attention Recommendation PDF
2021-05-09 A Hybrid Model for Combining Neural Image Caption and k-Nearest Neighbor Approach for Image Captioning Kartik Arora, Ajul Raj, Arun Goel, Seba Susan arXiv_CV arXiv_CV Image_Caption Pose Caption PDF
2021-05-06 Exploring Explicit and Implicit Visual Relationships for Image Captioning Zeliang Song, Xiaofei Zhou arXiv_CV arXiv_CV Image_Caption Transformer Bert Salient Pose Action Relation Visual_Relation Caption CNN PDF
2021-05-01 Audio Transformers:Transformer Architectures For Large Scale Audio Understanding. Adieu Convolutions Prateek Verma, Jonathan Berger arXiv_SD arXiv_SD Image_Caption Transformer Embedding Unsupervised Pose Classification GAN CNN PDF
2021-04-30 CoCon: Cooperative-Contrastive Learning Nishant Rai, Ehsan Adeli, Kuan-Hui Lee, Adrien Gaidon, Juan Carlos Niebles arXiv_CV arXiv_CV Image_Caption Segmentation Recognition Represenation_Learning Self-Supervised Pose Contrastive_Learning Action_Recognition Action Relation PDF
2021-04-30 End-to-End Attention-based Image Captioning Carola Sundaramoorthy, Lin Ziwen Kelvin, Mahak Sarin, Shubham Gupta arXiv_AI arXiv_AI Image_Caption Transformer RNN Pose Attention Caption PDF
2021-04-28 Removing Word-Level Spurious Alignment between Images and Pseudo-Captions in Unsupervised Image Captioning Ukyo Honda, Yoshitaka Ushiku, Atsushi Hashimoto, Taro Watanabe, Yuji Matsumoto arXiv_CV arXiv_CV Image_Caption Unsupervised Pose Caption PDF
2021-04-27 Rethinking BiSeNet For Real-time Semantic Segmentation Mingyuan Fan, Shenqi Lai, Junshi Huang, Xiaoming Wei, Zhenhua Chai, Junfeng Luo, Xiaolin Wei arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation Pose Classification Image_Classification Inference PDF
2021-04-27 Dual Transformer for Point Cloud Analysis Xian-Feng Han, Yi-Fei Jin, Hui-Xian Cheng, Guo-Qiang Xiao arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Point_Cloud 3D Represenation_Learning Pose Quantitative Classification Attention PDF
2021-04-26 Contextualized Keyword Representations for Multi-modal Retinal Image Captioning Jia-Hong Huang, Ting-Wei Wu, Marcel Worring arXiv_AI arXiv_AI Image_Caption Pose Attention Medical Caption PDF
2021-04-24 RelTransformer: Balancing the Visual Relationship Detection from Local Context, Scene and Memory Jun Chen, Aniket Agarwal, Sherif Abdelkarim, Deyao Zhu, Mohamed Elhoseiny arXiv_AI arXiv_AI Image_Caption Transformer Recognition Pose Detection Relation VQA Visual_Relation Caption Prediction QA PDF
2021-04-23 Towards Accurate Text-based Image Captioning with Content Diversity Exploration Guanghui Xu, Shuaicheng Niu, Mingkui Tan, Yucheng Luo, Qing Du, Qi Wu arXiv_CV arXiv_CV Image_Caption Pose Relation Attention Caption PDF
2021-04-23 Learning from Ambiguous Labels for Lung Nodule Malignancy Prediction Zehui Liao, Yutong Xie, Shishuai Hu, Yong Xia arXiv_CV arXiv_CV Image_Caption Pose Deep_Learning Attention Prediction PDF
2021-04-22 Heterogeneous Grid Convolution for Adaptive, Efficient, and Controllable Computation Ryuhei Hamaguchi, Yasutaka Furukawa, Masaki Onishi, Ken Sakurada arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation Salient Pose Action Detection Object_Detection CNN PDF
2021-04-18 CLIPScore: A Reference-free Evaluation Metric for Image Captioning Jack Hessel, Ari Holtzman, Maxwell Forbes, Ronan Le Bras, Yejin Choi arXiv_CV arXiv_CV Image_Caption Knowledge Relation Caption PDF
2021-04-16 'Wikily' Neural Machine Translation Tailored to Cross-Lingual Tasks Mohammad Sadegh Rasooli, Chris Callison-Burch, Derry Tanti Wijaya arXiv_CV arXiv_CV Image_Caption Embedding Unsupervised Caption PDF
2021-04-16 Concadia: Tackling image accessibility with context Elisa Kreiss, Noah D. Goodman, Christopher Potts arXiv_CL arXiv_CL Image_Caption Embedding Knowledge Pose Caption PDF
2021-04-16 Does language help generalization in vision models? Benjamin Devillers, Romain Bielawski, Bhavin Choski, Rufin VanRullen arXiv_AI arXiv_AI Image_Caption Unsupervised Zero-Shot Few-Shot Caption Language_Model PDF
2021-04-16 Cross-Modal Retrieval Augmentation for Multi-Modal Classification Shir Gur, Natalia Neverova, Chris Stauffer, Ser-Nam Lim, Douwe Kiela, Austin Reiter arXiv_CV arXiv_CV Image_Caption Transformer Embedding Knowledge Classification VQA Caption Inference QA PDF
2021-04-16 Structural Beauty: A Structure-based Approach to Quantifying the Beauty of an Image Bin Jiang, Chris de Rijke arXiv_CV arXiv_CV Image_Caption Quantitative PDF
2021-04-09 Towards Fine-grained Visual Representations by Combining Contrastive Learning with Image Reconstruction and Attention-weighted Pooling Jonas Dippel, Steffen Dippel, Johannes Höhne arXiv_AI arXiv_AI Image_Caption Reconstruction Self-Supervised Contrastive_Learning Classification Attention PDF
2021-04-09 SI-Score: An image dataset for fine-grained analysis of robustness to object location, rotation and size Jessica Yung, Rob Romijnders, Alexander Kolesnikov, Lucas Beyer, Josip Djolonga, Neil Houlsby, Sylvain Gelly, Mario Lucic, Xiaohua Zhai arXiv_AI arXiv_AI Image_Caption Transformer Prediction PDF
2021-04-08 HindSight: A Graph-Based Vision Model Architecture For Representing Part-Whole Hierarchies Muhammad AbdurRafae arXiv_AI arXiv_AI Image_Caption Self-Supervised Pose Action Classification Detection Object_Detection Caption Image_Classification PDF
2021-04-06 Fourier Image Transformer Tim-Oliver Buchholz, Florian Jug arXiv_CV arXiv_CV Image_Caption Transformer Reconstruction Pose Classification CNN Image_Classification PDF
2021-04-06 Visual Camera Re-Localization Using Graph Neural Networks and Relative Pose Supervision Mehmet Ozgur Turkoglu, Eric Brachmann, Konrad Schindler, Gabriel Brostow, Aron Monszpart arXiv_CV arXiv_CV Image_Caption Optimization Pose Inference PDF
2021-04-06 Scene Graph Embeddings Using Relative Similarity Supervision Paridhi Maheshwari, Ritwick Chaudhry, Vishwa Vinay arXiv_CV arXiv_CV Image_Caption Embedding Image_Retrieval Pose Contrastive_Learning Classification CNN PDF
2021-04-05 Compressing Visual-linguistic Model via Knowledge Distillation Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lijuan Wang, Yezhou Yang, Zicheng Liu arXiv_AI arXiv_AI Image_Caption Transformer Knowledge Pose Detection VQA Object_Detection Attention Caption QA PDF
2021-04-05 Non-Homogeneous Haze Removal via Artificial Scene Prior and Bidimensional Graph Reasoning Haoran Wei, Qingbo Wu, Hui Li, King Ngi Ngan, Hongliang Li, Fanman Meng, Linfeng Xu arXiv_CV arXiv_CV Image_Caption Pose Relation PDF
2021-04-05 Task-Independent Knowledge Makes for Transferable Representations for Generalized Zero-Shot Learning Chaoqun Wang, Xuejin Chen, Shaobo Min, Xiaoyan Sun, Houqiang Li arXiv_AI arXiv_AI Image_Caption Embedding Zero-Shot Knowledge Pose Contrastive_Learning PDF
2021-04-01 RePOSE: Real-Time Iterative Rendering and Refinement for 6D Object Pose Estimation Shun Iwase, Xingyu Liu, Rawal Khirodkar, Rio Yokota, Kris M. Kitani arXiv_CV arXiv_CV Image_Caption Optimization Pose_Estimation Pose CNN PDF
2021-03-29 Visual Distant Supervision for Scene Graph Generation Yuan Yao, Ao Zhang, Xu Han, Mengdi Li, Cornelius Weber, Zhiyuan Liu, Stefan Wermter, Maosong Sun arXiv_CV arXiv_CV Image_Caption Weakly_Supervised Knowledge Pose Classification Relation Visual_Relation PDF
2021-03-28 On Hallucination and Predictive Uncertainty in Conditional Language Generation Yijun Xiao, William Yang Wang arXiv_CL arXiv_CL Image_Caption Pose Relation Text_Generation Caption PDF
2021-03-27 A Survey of Orthogonal Moments for Image Representation: Theory, Implementation, and Evaluation Shuren Qi, Yushu Zhang, Chao Wang, Jiantao Zhou, Xiaochun Cao arXiv_CV arXiv_CV Image_Caption Recognition Optimization Survey PDF
2021-03-26 Bidirectional Projection Network for Cross Dimension Scene Understanding Wenbo Hu, Hengshuang Zhao, Li Jiang, Jiaya Jia, Tien-Tsin Wong arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation Recognition Point_Cloud 3D Pose Quantitative PDF
2021-03-26 Contrastive Learning based Hybrid Networks for Long-Tailed Image Classification Peng Wang, Kai Han, Xiu-Shen Wei, Lei Zhang, Lei Wang arXiv_CV arXiv_CV Image_Caption Embedding Unsupervised Represenation_Learning Pose Contrastive_Learning Classification Image_Classification PDF
2021-03-24 DRANet: Disentangling Representation and Adaptation Networks for Unsupervised Cross-Domain Adaptation Seunghun Lee, Sunghyun Cho, Sunghoon Im arXiv_CV arXiv_CV Image_Caption Segmentation Unsupervised Semantic_Segmentation Pose Classification PDF
2021-03-24 Relation-aware Instance Refinement for Weakly Supervised Visual Grounding Yongfei Liu, Bo Wan, Lin Ma, Xuming He arXiv_CV arXiv_CV Image_Caption Weakly_Supervised Pose Classification Relation Caption Matching PDF
2021-03-23 UltraSR: Spatial Encoding is a Missing Key for Implicit Image Function-based Arbitrary-Scale Super-Resolution Xingqian Xu, Zhangyang Wang, Humphrey Shi arXiv_CV arXiv_CV Image_Caption Super_Resolution Pose Prediction PDF
2021-03-22 Human-like Controllable Image Captioning with Verb-specific Semantic Roles Long Chen, Zhihong Jiang, Jun Xiao, Wei Liu arXiv_AI arXiv_AI Image_Caption Pose Attention Caption Activity PDF
2021-03-21 #PraCegoVer: A Large Dataset for Image Captioning in Portuguese Gabriel Oliveira dos Santos, Esther Luna Colombini, Sandra Avila arXiv_CV arXiv_CV Image_Caption Pose Action Relation Caption PDF
2021-03-20 3M: Multi-style image caption generation using Multi-modality features under Multi-UPDOWN model Chengxi Li, Brent Harrison arXiv_CV arXiv_CV Image_Caption Pose Caption PDF
2021-03-18 Space-Time Crop & Attend: Improving Cross-modal Video Representation Learning Mandela Patrick, Yuki M. Asano, Bernie Huang, Ishan Misra, Florian Metze, Joao Henriques, Andrea Vedaldi arXiv_CV arXiv_CV Image_Caption Transformer Represenation_Learning Self-Supervised Pose Attention PDF
2021-03-17 Automatic Generation of Contrast Sets from Scene Graphs: Probing the Compositional Consistency of GQA Yonatan Bitton, Gabriel Stanovsky, Roy Schwartz, Michael Elhadad arXiv_CV arXiv_CV Image_Caption Relation VQA QA PDF
2021-03-17 Scene Graphs: A Survey of Generations and Applications Xiaojun Chang, Pengzhen Ren, Pengfei Xu, Zhihui Li, Xiaojiang Chen, Alex Hauptmann arXiv_CV arXiv_CV Image_Caption Knowledge Survey Detection Relation VQA Attention Visual_Relation Caption QA PDF
2021-03-15 Knowledge driven Description Synthesis for Floor Plan Interpretation Shreya Goyal, Chiranjoy Chattopadhyay, Gaurav Bhatnagar arXiv_CV arXiv_CV Image_Caption Transformer Knowledge Pose Action Text_Generation Caption PDF
2021-03-14 SemVLP: Vision-Language Pre-training by Aligning Semantics at Multiple Levels Chenliang Li, Ming Yan, Haiyang Xu, Fuli Luo, Wei Wang, Bin Bi, Songfang Huang arXiv_CL arXiv_CL Image_Caption Transformer Pose Action Attention PDF
2021-03-12 Information Maximization Clustering via Multi-View Self-Labelling Foivos Ntelemis, Yaochu Jin, Spencer A. Thomas arXiv_CV arXiv_CV Image_Caption Self-Supervised Pose PDF
2021-03-10 VideoMoCo: Contrastive Video Representation Learning with Temporally Adversarial Examples Tian Pan, Yibing Song, Tianyu Yang, Wenhao Jiang, Wei Liu arXiv_CV arXiv_CV Image_Caption Unsupervised Represenation_Learning Adversarial Pose Contrastive_Learning PDF
2021-03-08 Multiple Instance Captioning: Learning Representations from Histopathology Textbooks and Articles Jevgenij Gamper, Nasir Rajpoot arXiv_AI arXiv_AI Image_Caption Self-Supervised Caption PDF
2021-03-08 Analysis of Convolutional Decoder for Image Caption Generation Sulabh Katiyar, Samir Kumar Borgohain arXiv_CV arXiv_CV Image_Caption RNN Pose Attention Caption CNN PDF
2021-03-08 Relationship-based Neural Baby Talk Fan Fu, Tingting Xie, Ioannis Patras, Sepehr Jalali arXiv_AI arXiv_AI Image_Caption Pose Action Relation Attention Caption PDF
2021-03-08 Boosting Semi-supervised Image Segmentation with Global and Local Mutual Information Regularization Jizong Peng, Marco Pedersoli, Christian Desrosiers arXiv_CV arXiv_CV Image_Caption Segmentation Embedding Regularization Pose Deep_Learning Medical PDF
2021-03-08 Multimodal Representation Learning via Maximization of Local Mutual Information Ruizhi Liao, Daniel Moyer, Miriam Cha, Keegan Quigley, Seth Berkowitz, Steven Horng, Polina Golland, William M. Wells arXiv_CV arXiv_CV Image_Caption Represenation_Learning Pose Classification Image_Classification PDF
2021-03-07 Rethinking Class Relations: Absolute-relative Supervised and Unsupervised Few-shot Learning Hongguang Zhang, Philip H. S. Torr, Hongdong Li, Songlei Jian, Piotr Koniusz arXiv_CV arXiv_CV Image_Caption Unsupervised Pose Classification Relation Few-Shot PDF
2021-03-06 Imbalance-Aware Self-Supervised Learning for 3D Radiomic Representations Hongwei Li, Fei-Fei Xue, Krishna Chaitanya, Shengda Liu, Ivan Ezhov, Benedikt Wiestler, Jianguo Zhang, Bjoern Menze arXiv_AI arXiv_AI Image_Caption Unsupervised 3D Represenation_Learning Self-Supervised Pose Classification Deep_Learning Medical PDF
2021-03-05 Face2Text: Collecting an Annotated Image Description Corpus for the Generation of Rich Face Descriptions Albert Gatt, Marc Tanti, Adrian Muscat, Patrizia Paggio, Reuben A. Farrugia, Claudia Borg, Kenneth P. Camilleri, Mike Rosner, Lonneke van der Plas arXiv_AI arXiv_AI Image_Caption Emotion Face Relation PDF
2021-03-05 Constrained Contrastive Distribution Learning for Unsupervised Anomaly Detection and Localisation in Medical Images Yu Tian, Guansong Pang, Fengbei Liu, Yuanhong chen, Seon Ho Shin, Johan W. Verjans, Rajvinder Singh, Gustavo Carneiro arXiv_CV arXiv_CV Image_Caption Unsupervised Represenation_Learning Self-Supervised Pose Contrastive_Learning Face Detection Medical PDF
2021-03-04 Visual Question Answering: which investigated applications? Silvio Barra, Carmen Bisogni, Maria De Marsico, Stefano Ricciardi arXiv_CV arXiv_CV Image_Caption Pose Survey VQA Summarization Caption QA PDF
2021-03-03 DeepFN: Towards Generalizable Facial Action Unit Recognition with Deep Face Normalization Javier Hernandez, Daniel McDuff, Ognjen (Oggi) Rudovic, Alberto Fung, Mary Czerwinski arXiv_AI arXiv_AI Image_Caption Recognition Self-Supervised Face Action_Recognition Action Denoising Caption PDF
2021-03-02 Semantic Relation Reasoning for Shot-Stable Few-Shot Object Detection Chenchen Zhu, Fangyi Chen, Uzair Ahmed, Marios Savvides arXiv_CV arXiv_CV Image_Caption Embedding Knowledge Knowledge_Graph Pose Classification Detection Relation Few-Shot Object_Detection PDF
2021-02-26 Learning Transferable Visual Models From Natural Language Supervision Alec Radford, Jong Wook Kim, Chris Hallacy, Aditya Ramesh, Gabriel Goh, Sandhini Agarwal, Girish Sastry, Amanda Askell, Pamela Mishkin, Jack Clark, Gretchen Krueger, Ilya Sutskever arXiv_CV arXiv_CV Image_Caption Recognition OCR Zero-Shot Action_Recognition Action Classification Caption PDF
2021-02-25 Retrieval Augmentation to Improve Robustness and Interpretability of Deep Neural Networks Rita Parada Ramos, Patrícia Pereira, Helena Moniz, Joao Paulo Carvalho, Bruno Martins arXiv_CL arXiv_CL Image_Caption RNN Pose Sentiment Attention Caption Prediction PDF
2021-02-25 A Primer on Contrastive Pretraining in Language Processing: Methods, Lessons Learned and Perspectives Nils Rethmeier, Isabelle Augenstein arXiv_AI arXiv_AI Image_Caption Zero-Shot Adversarial Self-Supervised Contrastive_Learning Survey Relation Language_Model PDF
2021-02-23 Enhanced Modality Transition for Image Captioning Ziwei Wang, Yadan Luo, Zi Huang arXiv_CV arXiv_CV Image_Caption Knowledge Pose Caption Language_Model PDF
2021-02-23 Comparative evaluation of CNN architectures for Image Caption Generation Sulabh Katiyar, Samir Kumar Borgohain arXiv_CV arXiv_CV Image_Caption Transfer_Learning Recognition Knowledge Action Deep_Learning Attention Caption CNN PDF
2021-02-22 Image Captioning using Deep Stacked LSTMs, Contextual Word Embeddings and Data Augmentation Sulabh Katiyar, Samir Kumar Borgohain arXiv_AI arXiv_AI Image_Caption Embedding RNN Pose Deep_Learning Attention Caption CNN PDF
2021-02-22 Probing Multimodal Embeddings for Linguistic Properties: the Visual-Semantic Case Adam Dahlgren Lindström, Suna Bensch, Johanna Björklund, Frank Drewes arXiv_CV arXiv_CV Image_Caption Embedding Pose Caption PDF
2021-02-21 Transferable Visual Words: Exploiting the Semantics of Anatomical Patterns for Self-supervised Learning Fatemeh Haghighi, Mohammad Reza Hosseinzadeh Taher, Zongwei Zhou, Michael B. Gotway, Jianming Liang arXiv_CV arXiv_CV Image_Caption Transfer_Learning Restoration Self-Supervised Pose Classification Deep_Learning Medical PDF
2021-02-21 Contrastive Self-supervised Neural Architecture Search Nam Nguyen, J. Morris Chang arXiv_AI arXiv_AI Image_Caption NAS Optimization Self-Supervised Pose Face PDF
2021-02-20 VisualGPT: Data-efficient Image Captioning by Balancing Visual Input and Linguistic Knowledge from Pretraining Jun Chen, Han Guo, Kai Yi, Boyang Li, Mohamed Elhoseiny arXiv_AI arXiv_AI Image_Caption Sparse Knowledge Pose Attention Caption Language_Model PDF
2021-02-19 Progressive Transformer-Based Generation of Radiology Reports Farhad Nooralahzadeh, Nicolas Perez Gonzalez, Thomas Frauenfelder, Koji Fujimoto, Michael Krauthammer arXiv_CL arXiv_CL Image_Caption Transformer Pose PDF
2021-02-18 Hierarchical Attention Fusion for Geo-Localization Liqi Yan, Yiming Cui, Yingjie Chen, Dongfang Liu arXiv_CV arXiv_CV Image_Caption Image_Retrieval Self-Supervised Attention GAN CNN PDF
2021-02-17 Conceptual 12M: Pushing Web-Scale Image-Text Pre-Training To Recognize Long-Tail Visual Concepts Soravit Changpinyo, Piyush Sharma, Nan Ding, Radu Soricut arXiv_CV arXiv_CV Image_Caption Recognition Quantitative VQA Caption PDF
2021-02-14 Improved Bengali Image Captioning via deep convolutional neural network based encoder-decoder model Mohammad Faiyaz Khan, S.M. Sadiq-Ur-Rahman Shifath, Md. Saiful Islam arXiv_CV arXiv_CV Image_Caption Caption CNN PDF
2021-02-14 Image Captioning using Multiple Transformers for Self-Attention Mechanism Farrukh Olimov, Shikha Dubey, Labina Shrestha, Tran Trung Tin, Moongu Jeon arXiv_AI