Image_Caption

2022-12-08 CiaoSR: Continuous Implicit Attention-in-Attention Network for Arbitrary-Scale Image Super-Resolution Jiezhang Cao, Qin Wang, Yongqin Xian, Yawei Li, Bingbing Ni, Zhiming Pi, Kai Zhang, Yulun Zhang, Radu Timofte, Luc Van Gool arXiv_CV arXiv_CV Image_Caption Super_Resolution Pose Attention PDF
2022-12-08 Generating and Weighting Semantically Consistent Sample Pairs for Ultrasound Contrastive Learning Yixiong Chen, Chunhui Zhang, Chris H. Q. Ding, Li Liu arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Self-Supervised Pose Contrastive_Learning Classification Detection Medical PDF
2022-12-06 Switching to Discriminative Image Captioning by Relieving a Bottleneck of Reinforcement Learning Ukyo Honda, Taro Watanabe, Yuji Matsumoto arXiv_CV arXiv_CV Image_Caption Reinforcement_Learning Pose Classification Caption PDF
2022-12-06 Semantic-Conditional Diffusion Networks for Image Captioning Jianjie Luo, Yehao Li, Yingwei Pan, Ting Yao, Jianlin Feng, Hongyang Chao, Tao Mei arXiv_CV arXiv_CV Image_Caption Transformer Knowledge Pose Caption PDF
2022-12-06 Adaptive Testing of Computer Vision Models Irena Gao, Gabriel Ilharco, Scott Lundberg, Marco Tulio Ribeiro arXiv_CV arXiv_CV Image_Caption Face Classification Detection Object_Detection Caption PDF
2022-12-06 Attend Who is Weak: Pruning-assisted Medical Image Localization under Sophisticated and Implicit Imbalances Ajay Jaiswal, Tianlong Chen, Justin F. Rousseau, Yifan Peng, Ying Ding, Zhangyang Wang arXiv_CV arXiv_CV Image_Caption Pose Classification Attention Medical Image_Classification PDF
2022-12-04 Controllable Image Captioning via Prompting Ning Wang, Jiahao Xie, Jihao Wu, Mingbo Jia, Linlin Li arXiv_CV arXiv_CV Image_Caption Embedding Pose Emotion Caption Inference PDF
2022-12-02 Generative Reasoning Integrated Label Noise Robust Deep Image Representation Learning in Remote Sensing Gencer Sumbul, Begüm Demir arXiv_CV arXiv_CV Image_Caption Represenation_Learning Deep_Learning Attention PDF
2022-12-02 SimpleMind adds thinking to deep neural networks Youngwon Choi, M. Wasil Wahi-Anwar, Matthew S. Brown arXiv_AI arXiv_AI Image_Caption Embedding Optimization Knowledge Pose Relation Medical Prediction PDF
2022-12-02 QFF: Quantized Fourier Features for Neural Field Representations Jae Yong Lee, Yuqun Wu, Chuhang Zou, Shenlong Wang, Derek Hoiem arXiv_CV arXiv_CV Image_Caption Pose PDF
2022-12-01 Weakly Supervised Annotations for Multi-modal Greeting Cards Dataset Sidra Hanif, Longin Jan Latecki arXiv_AI arXiv_AI Image_Caption Embedding Weakly_Supervised Pose Caption PDF
2022-12-01 Focus! Relevant and Sufficient Context Selection for News Image Captioning Mingyang Zhou, Grace Luo, Anna Rohrbach, Zhou Yu arXiv_CV arXiv_CV Image_Caption Pose Action Relation Relation_Extraction Caption PDF
2022-11-30 Uncertainty-Aware Image Captioning Zhengcong Fei, Mingyuan Fan, Li Zhu, Junshi Huang, Xiaoming Wei, Xiaolin Wei arXiv_CV arXiv_CV Image_Caption Pose Caption Inference PDF
2022-11-29 Procedural Image Programs for Representation Learning Manel Baradad, Chun-Fu Chen, Jonas Wulff, Tongzhou Wang, Rogerio Feris, Antonio Torralba, Phillip Isola arXiv_CV arXiv_CV Image_Caption Transformer Unsupervised Represenation_Learning Knowledge Pose PDF
2022-11-28 Satlas: A Large-Scale, Multi-Task Dataset for Remote Sensing Image Understanding Favyen Bastani, Piper Wolters, Ritwik Gupta, Joe Ferdinando, Aniruddha Kembhavi arXiv_CV arXiv_CV Image_Caption Transformer Tracking Pose PDF
2022-11-28 SLAN: Self-Locator Aided Network for Cross-Modal Understanding Jiang-Tian Zhai, Qi Zhang, Tong Wu, Xing-Yu Chen, Jiang-Jiang Liu, Bo Ren, Ming-Ming Cheng arXiv_CV arXiv_CV Image_Caption Zero-Shot Image_Retrieval Pose Detection Object_Detection PDF
2022-11-27 MGDoc: Pre-training with Multi-granular Hierarchy for Document Image Understanding Zilong Wang, Jiuxiang Gu, Chris Tensmeyer, Nikolaos Barmpalios, Ani Nenkova, Tong Sun, Jingbo Shang, Vlad I. Morariu arXiv_CV arXiv_CV Image_Caption Transformer Embedding Pose Relation Attention GAN Language_Model PDF
2022-11-27 CLID: Controlled-Length Image Descriptions with Limited Data Elad Hirsch, Ayellet Tal arXiv_CV arXiv_CV Image_Caption Pose Caption PDF
2022-11-26 Predictive linguistic cues for fake news: a societal artificial intelligence problem Sandhya Aneja, Nagender Aneja, Ponnurangam Kumaraguru arXiv_CL arXiv_CL Image_Caption Pose Relation Caption PDF
2022-11-25 Aesthetically Relevant Image Captioning Zhipeng Zhong, Fei Zhou, Guoping Qiu arXiv_CV arXiv_CV Image_Caption Action Caption QA PDF
2022-11-25 Aggregated Text Transformer for Scene Text Detection Zhao Zhou, Xiangcheng Du, Yingbin Zheng, Cheng Jin arXiv_CV arXiv_CV Image_Caption Transformer Pose Scene_Text Action Detection Attention PDF
2022-11-24 Self-supervised vision-language pretraining for Medical visual question answering Pengfei Li, Gang Liu, Lin Tan, Jinying Liao, Shenjun Zhong arXiv_AI arXiv_AI Image_Caption Transformer Self-Supervised Pose Contrastive_Learning VQA Medical Caption Language_Model QA Matching PDF
2022-11-23 InDiReCT: Language-Guided Zero-Shot Deep Metric Learning for Images Konstantin Kobs, Michael Steininger, Andreas Hotho arXiv_AI arXiv_AI Image_Caption Embedding Zero-Shot Image_Retrieval Pose PDF
2022-11-22 Retrieval-Augmented Multimodal Language Modeling Michihiro Yasunaga, Armen Aghajanyan, Weijia Shi, Rich James, Jure Leskovec, Percy Liang, Mike Lewis, Luke Zettlemoyer, Wen-tau Yih arXiv_CV arXiv_CV Image_Caption Transformer Knowledge Pose Text_Generation Caption Language_Model PDF
2022-11-22 Progressive Learning with Cross-Window Consistency for Semi-Supervised Semantic Segmentation Bo Dang, Yansheng Li arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation Pose Medical PDF
2022-11-22 Explaining Image Classifiers with Multiscale Directional Image Representation Stefan Kolek, Robert Windesheim, Hector Andrade Loarca, Gitta Kutyniok, Ron Levie arXiv_CV arXiv_CV Image_Caption Regularization Pose PDF
2022-11-21 Exploring Discrete Diffusion Models for Image Captioning Zixin Zhu, Yixuan Wei, Jianfeng Wang, Zhe Gan, Zheng Zhang, Le Wang, Gang Hua, Lijuan Wang, Zicheng Liu, Han Hu arXiv_CV arXiv_CV Image_Caption Transformer Pose Attention Caption Inference Prediction PDF
2022-11-21 Place Recognition under Occlusion and Changing Appearance via Disentangled Representations Yue Chen, Xingyu Chen arXiv_CV arXiv_CV Image_Caption Unsupervised Recognition Pose Autonomous PDF
2022-11-20 Real-time Local Feature with Global Visual Information Enhancement Jinyu Miao, Haosong Yue, Zhong Liu, Xingming Wu, Zaojun Fang, Guilin Yang arXiv_CV arXiv_CV Image_Caption Enhancement Reinforcement_Learning Pose Deep_Learning CNN Matching PDF
2022-11-20 ESTAS: Effective and Stable Trojan Attacks in Self-supervised Encoders with One Target Unlabelled Sample Jiaqi Xue, Qian Lou arXiv_CV arXiv_CV Image_Caption Optimization Self-Supervised Pose Action PDF
2022-11-19 Rethinking Batch Sample Relationships for Data Representation: A Batch-Graph Transformer based Approach Xixi Wang, Bo Jiang, Xiao Wang, Bin Luo arXiv_CV arXiv_CV Image_Caption Transformer Sparse Pose Relation Attention PDF
2022-11-17 I Can't Believe There's No Images! Learning Visual Tasks Using only Language Data Sophia Gu, Christopher Clark, Aniruddha Kembhavi arXiv_CV arXiv_CV Image_Caption Embedding VQA Caption Language_Model PDF
2022-11-17 Progressive Tree-Structured Prototype Network for End-to-End Image Captioning Pengpeng Zeng, Jinkuan Zhu, Jingkuan Song, Lianli Gao arXiv_CV arXiv_CV Image_Caption Transformer Embedding Pose Relation Caption Inference Prediction PDF
2022-11-17 Feedback is Needed for Retakes: An Explainable Poor Image Notification Framework for the Visually Impaired Kazuya Ohata, Shunsuke Kitada, Hitoshi Iyatomi arXiv_CV arXiv_CV Image_Caption Pose Detection Caption PDF
2022-11-17 CapEnrich: Enriching Caption Semantics for Web Images via Cross-modal Pre-trained Knowledge Linli Yao, Weijing Chen, Qin Jin arXiv_CV arXiv_CV Image_Caption Transformer Knowledge Pose Caption Recommendation PDF
2022-11-17 Learning Domain and Pose Invariance for Thermal-to-Visible Face Recognition Cedric Nimpa Fondje, Shuowen Hu, Benjamin S. Riggan arXiv_CV arXiv_CV Image_Caption Recognition Pose Face Face_Recognition Matching PDF
2022-11-15 PromptCap: Prompt-Guided Task-Aware Image Captioning Yushi Hu, Hang Hua, Zhengyuan Yang, Weijia Shi, Noah A. Smith, Jiebo Luo arXiv_CV arXiv_CV Image_Caption Transformer Zero-Shot Pose Scene_Text VQA Caption Language_Model QA PDF
2022-11-15 Versatile Diffusion: Text, Images and Variations All in One Diffusion Model Xingqian Xu, Zhangyang Wang, Eric Zhang, Kai Wang, Humphrey Shi arXiv_CV arXiv_CV Image_Caption PDF
2022-11-14 Learning to Model Multimodal Semantic Alignment for Story Visualization Bowen Li, Thomas Lukasiewicz arXiv_CV arXiv_CV Image_Caption Segmentation Face Action GAN Caption PDF
2022-11-14 Zero-shot Image Captioning by Anchor-augmented Vision-Language Space Alignment Junyang Wang, Yi Zhang, Ming Yan, Ji Zhang, Jitao Sang arXiv_CV arXiv_CV Image_Caption Transformer Unsupervised Zero-Shot Image_Retrieval Pose Classification Relation Attention Caption Language_Model PDF
2022-11-14 ContextCLIP: Contextual Alignment of Image-Text pairs on CLIP visual representations Chanda Grover, Indra Deep Mastan, Debayan Gupta arXiv_CV arXiv_CV Image_Caption Embedding Zero-Shot Image_Retrieval Pose Contrastive_Learning Quantitative Classification Caption PDF
2022-11-13 Large-Scale Bidirectional Training for Zero-Shot Image Captioning Taehoon Kim, Mark Marsden, Pyunghwan Ahn, Sangyun Kim, Sihaeng Lee, Alessandra Sala, Seung Hwan Kim arXiv_CV arXiv_CV Image_Caption Zero-Shot Pose Action Caption Inference PDF
2022-11-12 AltCLIP: Altering the Language Encoder in CLIP for Extended Language Capabilities Zhongzhi Chen, Guang Liu, Bo-Wen Zhang, Fulong Ye, Qinghong Yang, Ledell Wu arXiv_CL arXiv_CL Image_Caption Contrastive_Learning PDF
2022-11-12 DeltaNet:Conditional Medical Report Generation for COVID-19 Diagnosis Xian Wu, Shuxin Yang, Zhaopeng Qiu, Shen Ge, Yangtian Yan, Xingwang Wu, Yefeng Zheng, S. Kevin Zhou, Li Xiao arXiv_CV arXiv_CV Image_Caption Pose Medical Caption PDF
2022-11-12 Investigations in Audio Captioning: Addressing Vocabulary Imbalance and Evaluating Suitability of Language-Centric Performance Metrics Sandeep Kothinti, Dimitra Emmanouilidou arXiv_SD arXiv_SD Image_Caption Pose Action Caption PDF
2022-11-10 VieCap4H - VLSP 2021: ObjectAoA -- Enhancing performance of Object Relation Transformer with Attention on Attention for Vietnamese image captioning Nghia Hieu Nguyen, Duong T.D. Vo, Minh-Quan Ha arXiv_CL arXiv_CL Image_Caption Transformer Pose Relation Attention Caption PDF
2022-11-09 Safe Latent Diffusion: Mitigating Inappropriate Degeneration in Diffusion Models Patrick Schramowski, Manuel Brack, Björn Deiseroth, Kristian Kersting arXiv_AI arXiv_AI Image_Caption PDF
2022-11-09 Understanding Cross-modal Interactions in V&L Models that Generate Scene Descriptions Michele Cafagna, Albert Gatt, Kees van Deemter arXiv_CL arXiv_CL Image_Caption Action Caption Language_Model PDF
2022-11-09 Visual Named Entity Linking: A New Dataset and A Baseline Wenxiang Sun, Yixing Fan, Jiafeng Guo, Ruqing Zhang, Xueqi Cheng arXiv_AI arXiv_AI Image_Caption Image_Retrieval Knowledge Pose VQA Caption PDF
2022-11-06 Distilling Representations from GAN Generator via Squeeze and Span Yu Yang, Xiaotian Cheng, Chang Liu, Hakan Bilen, Xiangyang Ji arXiv_CV arXiv_CV Image_Caption Represenation_Learning Knowledge Adversarial Self-Supervised Pose GAN PDF
2022-11-04 OSIC: A New One-Stage Image Captioner Coined Bo Wang, Zhao Zhang, Mingbo Zhao, Xiaojie Jin, Mingliang Xu, Meng Wang arXiv_CV arXiv_CV Image_Caption Transformer Embedding Pose Action Detection Object_Detection Text_Generation Caption Language_Model PDF
2022-11-02 MuMIC -- Multimodal Embedding for Multi-label Image Classification with Tempered Sigmoid Fengjun Wang, Sarai Mizrachi, Moran Beladev, Guy Nadav, Gil Amsalem, Karen Lastmann Assaraf, Hadas Harush Boker arXiv_CV arXiv_CV Image_Caption Embedding Transfer_Learning Zero-Shot Optimization Represenation_Learning Knowledge Pose Classification Image_Classification Prediction PDF
2022-11-01 Text-Only Training for Image Captioning using Noise-Injected CLIP David Nukrai, Ron Mokady, Amir Globerson arXiv_AI arXiv_AI Image_Caption Embedding Style_Transfer Zero-Shot Pose Caption PDF
2022-10-28 DiMBERT: Learning Vision-Language Grounded Representations with Disentangled Multimodal-Attention Fenglin Liu, Xian Wu, Shen Ge, Xuancheng Ren, Wei Fan, Xu Sun, Yuexian Zou arXiv_CL arXiv_CL Image_Caption Transformer Bert Pose Classification Relation Attention Caption Language_Model PDF
2022-10-26 FaD-VLP: Fashion Vision-and-Language Pre-training towards Unified Retrieval and Captioning Suvir Mirchandani, Licheng Yu, Mengjiao Wang, Animesh Sinha, Wenwen Jiang, Tao Xiang, Ning Zhang arXiv_AI arXiv_AI Image_Caption Transformer Image_Retrieval Pose Caption PDF
2022-10-26 Visual Semantic Parsing: From Images to Abstract Meaning Representation Mohamed Ashraf Abdelsalam, Zhan Shi, Federico Fancellu, Kalliopi Basioti, Dhaivat J. Bhatt, vladimir pavlovic, Afsaneh Fazly arXiv_CV arXiv_CV Image_Caption Pose Relation Attention PDF
2022-10-26 Bloom Library: Multimodal Datasets in 300+ Languages for a Variety of Downstream Tasks Colin Leong, Joshua Nemecek, Jacob Mansdorfer, Anna Filighera, Abraham Owodunni, Daniel Whitenack arXiv_AI arXiv_AI Image_Caption Recognition Speech Face Caption Language_Model PDF
2022-10-24 Learning by Hallucinating: Vision-Language Pre-training with Weak Supervision Tzu-Jui Julius Wang, Jorma Laaksonen, Tomas Langer, Heikki Arponen, Tom E. Bishop arXiv_CV arXiv_CV Image_Caption Transformer Bert Image_Retrieval Pose Action VQA Caption PDF
2022-10-23 RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Data Yang Zhan, Zhitong Xiong, Yuan Yuan arXiv_CV arXiv_CV Image_Caption Transformer Embedding Salient Pose Deep_Learning VQA Caption PDF
2022-10-21 Improving the Factual Correctness of Radiology Report Generation with Semantic Rewards Jean-Benoit Delbrouck, Pierre Chambon, Christian Bluethgen, Emily Tsai, Omar Almusa, Curtis P. Langlotz arXiv_AI arXiv_AI Image_Caption Recognition Pose Face Relation Medical PDF
2022-10-21 Boosting vision transformers for image retrieval Chull Hwan Song, Jooyoung Yoon, Shunghyun Choi, Yannis Avrithis arXiv_CV arXiv_CV Image_Caption Transformer Image_Retrieval Pose Action Classification Detection CNN Image_Classification PDF
2022-10-21 Collaborative Image Understanding Koby Bibas, Oren Sar Shalom, Dietmar Jannach arXiv_CV arXiv_CV Image_Caption Pose Classification GAN Image_Classification Recommendation PDF
2022-10-21 PoseScript: 3D Human Poses from Natural Language Ginger Delmas, Philippe Weinzaepfel, Thomas Lucas, Francesc Moreno-Noguer, Grégory Rogez arXiv_CV arXiv_CV Image_Caption 3D Pose Relation VQA Caption PDF
2022-10-21 Generative Range Imaging for Learning Scene Priors of 3D LiDAR Data Kazuto Nakashima, Yumi Iwashita, Ryo Kurazume arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation 3D Restoration Adversarial Pose GAN Autonomous PDF
2022-10-20 Image-Text Retrieval with Binary and Continuous Label Supervision Zheng Li, Caili Guo, Zerun Feng, Jenq-Neng Hwang, Ying Jin, Yufeng Zhang arXiv_CV arXiv_CV Image_Caption Embedding Pose Relation Caption PDF
2022-10-20 Context-driven Visual Object Recognition based on Knowledge Graphs Sebastian Monka, Lavdim Halilaj, Achim Rettinger arXiv_AI arXiv_AI Image_Caption Transfer_Learning Recognition Knowledge Knowledge_Graph Pose Deep_Learning Prediction PDF
2022-10-20 General Image Descriptors for Open World Image Retrieval using ViT CLIP Marcos V. Conde, Ivan Aerlic, Simon Jégou arXiv_AI arXiv_AI Image_Caption Transformer Embedding Zero-Shot Image_Retrieval PDF
2022-10-20 Visual Spatial Description: Controlled Spatial-Oriented Image-to-Text Generation Yu Zhao, Jianguo Wei, Zhichao Lin, Yueheng Sun, Meishan Zhang, Min Zhang arXiv_CV arXiv_CV Image_Caption Pose Classification Relation Attention Text_Generation Caption PDF
2022-10-20 SSiT: Saliency-guided Self-supervised Image Transformer for Diabetic Retinopathy Grading Yijin Huang, Junyan Lyu, Pujin Cheng, Roger Tam, Xiaoying Tang arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Salient Knowledge Self-Supervised Pose Contrastive_Learning Medical PDF
2022-10-19 Prophet Attention: Predicting Attention with Future Attention for Improved Image Captioning Fenglin Liu, Xuewei Ma, Xuancheng Ren, Xian Wu, Wei Fan, Yuexian Zou, Xu Sun arXiv_CV arXiv_CV Image_Caption Pose Attention Caption PDF
2022-10-19 Image Semantic Relation Generation Mingzhe Du arXiv_CV arXiv_CV Image_Caption Segmentation Image_Retrieval Pose Detection Relation VQA Text_Generation Visual_Relation Autonomous PDF
2022-10-18 Aligning MAGMA by Few-Shot Learning and Finetuning Jean-Charles Layoun, Alexis Roger, Irina Rish arXiv_AI arXiv_AI Image_Caption Transformer Face VQA Few-Shot Caption Language_Model PDF
2022-10-18 Probing Cross-modal Semantics Alignment Capability from the Textual Perspective Zheng Ma, Shi Zong, Mianzhi Pan, Jianbing Zhang, Shujian Huang, Xinyu Dai, Jiajun Chen arXiv_CL arXiv_CL Image_Caption Transformer Bert Pose Attention Caption PDF
2022-10-17 Vision-Language Pre-training: Basics, Recent Advances, and Future Trends Zhe Gan, Linjie Li, Chunyuan Li, Lijuan Wang, Zicheng Liu, Jianfeng Gao arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Video_Caption Knowledge Review Face Survey Classification Detection VQA Few-Shot Object_Detection Caption Image_Classification PDF
2022-10-17 Weakly Supervised Face Naming with Symmetry-Enhanced Contrastive Loss Tingyu Qu, Tinne Tuytelaars, Marie-Francine Moens arXiv_CV arXiv_CV Image_Caption Weakly_Supervised Pose Contrastive_Learning Face Caption PDF
2022-10-17 Social Biases in Automatic Evaluation Metrics for NLG Mingqi Gao, Xiaojun Wan arXiv_AI arXiv_AI Image_Caption Embedding Pose Relation Summarization Text_Generation Caption Language_Model PDF
2022-10-17 Plug-and-Play VQA: Zero-shot VQA by Conjoining Large Pretrained Models with Zero Training Anthony Meng Huat Tiong, Junnan Li, Boyang Li, Silvio Savarese, Steven C.H. Hoi arXiv_CV arXiv_CV Image_Caption Zero-Shot Pose VQA Caption Language_Model QA PDF
2022-10-17 Runner-Up Solution to Google Universal Image Embedding Competition 2022 Xiaolong Huang, QianKun Li arXiv_CV arXiv_CV Image_Caption Embedding Recognition Classification Image_Classification PDF
2022-10-14 Learning image representations for anomaly detection: application to discovery of histological alterations in drug development Igor Zingman, Birgit Stierstorfer, Charlotte Lempp, Fabian Heinemann arXiv_AI arXiv_AI Image_Caption Pose Detection GAN CNN PDF
2022-10-13 MAPL: Parameter-Efficient Adaptation of Unimodal Pre-Trained Models for Vision-Language Few-Shot Prompting Oscar Mañas, Pau Rodriguez, Saba Ahmadi, Aida Nematzadeh, Yash Goyal, Aishwarya Agrawal arXiv_AI arXiv_AI Image_Caption Transformer Pose VQA Few-Shot Caption PDF
2022-10-13 Learning with Style: Continual Semantic Segmentation Across Tasks and Domains Marco Toldo, Umberto Michieli, Pietro Zanuttigh arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation Style_Transfer Knowledge Pose Face Deep_Learning Autonomous PDF
2022-10-12 Self-supervised video pretraining yields strong image representations Nikhil Parthasarathy, S. M. Ali Eslami, João Carreira, Olivier J. Hénaff arXiv_AI arXiv_AI Image_Caption Segmentation Transfer_Learning Semantic_Segmentation Knowledge Self-Supervised Pose Contrastive_Learning Detection Object_Detection PDF
2022-10-11 Visual Language Maps for Robot Navigation Chenguang Huang, Oier Mees, Andy Zeng, Wolfram Burgard arXiv_AI arXiv_AI Image_Caption Reconstruction 3D Pose Caption Autonomous Language_Model Matching PDF
2022-10-10 Not All Errors are Equal: Learning Text Generation Metrics using Stratified Error Synthesis Wenda Xu, Yilin Tuan, Yujie Lu, Michael Saxon, Lei Li, William Yang Wang arXiv_CL arXiv_CL Image_Caption Unsupervised Relation Text_Generation Caption PDF
2022-10-10 Generating image captions with external encyclopedic knowledge Sofia Nikiforova, Tejaswini Deoskar, Denis Paperno, Yoad Winter arXiv_CV arXiv_CV Image_Caption Knowledge Caption PDF
2022-10-10 Using Whole Slide Image Representations from Self-Supervised Contrastive Learning for Melanoma Concordance Regression Sean Grullon, Vaughn Spurrier, Jiayi Zhao, Corey Chivers, Yang Jiang, Kiran Motaparthi, Michael Bonham, Julianna Ianni arXiv_AI arXiv_AI Image_Caption Salient Self-Supervised Contrastive_Learning Action Deep_Learning PDF
2022-10-10 LSEH: Semantically Enhanced Hard Negatives for Cross-modal Information Retrieval Yan Gong, Georgina Cosma arXiv_CV arXiv_CV Image_Caption Embedding Pose PDF
2022-10-10 CLIP-Diffusion-LM: Apply Diffusion Model on Image Captioning Shitong Xu arXiv_CV arXiv_CV Image_Caption Denoising Text_Generation Caption Inference PDF
2022-10-09 Open-Vocabulary Semantic Segmentation with Mask-adapted CLIP Feng Liang, Bichen Wu, Xiaoliang Dai, Kunpeng Li, Yinan Zhao, Hang Zhang, Peizhao Zhang, Peter Vajda, Diana Marculescu arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Semantic_Segmentation Pose Caption Language_Model PDF
2022-10-09 VoLTA: Vision-Language Transformer with Weakly-Supervised Local-Feature Alignment Shraman Pramanick, Li Jing, Sayan Nag, Jiachen Zhu, Hardik Shah, Yann LeCun, Rama Chellappa arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Pose Detection Object_Detection Caption Matching PDF
2022-10-07 Towards Multi-Modal Sarcasm Detection via Hierarchical Congruity Modeling with Knowledge Enhancement Hui Liu, Wenya Wang, Haoliang Li arXiv_CL arXiv_CL Image_Caption Enhancement Knowledge Pose Detection Attention Caption PDF
2022-10-07 Pix2Struct: Screenshot Parsing as Pretraining for Visual Language Understanding Kenton Lee, Mandar Joshi, Iulia Turc, Hexiang Hu, Fangyu Liu, Julian Eisenschlos, Urvashi Khandelwal, Peter Shaw, Ming-Wei Chang, Kristina Toutanova arXiv_CV arXiv_CV Image_Caption OCR Face Caption Language_Model PDF
2022-10-05 Transferring dense object detection models to event-based data Vincenz Mechler, Pavel Rojtberg arXiv_CV arXiv_CV Image_Caption Sparse Pose Detection Object_Detection PDF
2022-10-05 Active Image Indexing Pierre Fernandez, Matthijs Douze, Hervé Jégou, Teddy Furon arXiv_AI arXiv_AI Image_Caption Quantization Detection PDF
2022-10-04 VICRegL: Self-Supervised Learning of Local Visual Features Adrien Bardes, Jean Ponce, Yann LeCun arXiv_AI arXiv_AI Image_Caption Segmentation Self-Supervised Pose Classification Detection CNN PDF
2022-10-04 Learning to Collocate Visual-Linguistic Neural Modules for Image Captioning Xu Yang, Hanwang Zhang, Chongyang Gao, Jianfei Cai arXiv_CV arXiv_CV Image_Caption Speech Pose VQA Attention Caption QA PDF
2022-10-03 Text-to-Audio Grounding Based Novel Metric for Evaluating Audio Caption Similarity Swapnil Bhosale, Rupayan Chakraborty, Sunil Kumar Kopparapu arXiv_AI arXiv_AI Image_Caption Pose Relation Text_Generation Caption PDF
2022-09-30 Contrastive Corpus Attribution for Explaining Representations Chris Lin, Hugh Chen, Chanwoo Kim, Su-In Lee arXiv_AI arXiv_AI Image_Caption Unsupervised Zero-Shot Pose Contrastive_Learning Quantitative PDF
2022-09-30 Medical Image Understanding with Pretrained Vision Language Models: A Comprehensive Study Ziyuan Qin, Huahui Yi, Qicheng Lao, Kang Li arXiv_CV arXiv_CV Image_Caption Zero-Shot Knowledge Medical Language_Model PDF
2022-09-30 SmallCap: Lightweight Image Captioning Prompted with Retrieval Augmentation Rita Ramos, Bruno Martins, Desmond Elliott, Yova Kementchedjhieva arXiv_CV arXiv_CV Image_Caption Transformer Attention Caption PDF
2022-09-30 Linearly Mapping from Image to Text Space Jack Merullo, Louis Castricato, Carsten Eickhoff, Ellie Pavlick arXiv_CL arXiv_CL Image_Caption Salient VQA Caption Language_Model PDF
2022-09-28 Weighted Contrastive Hashing Jiaguo Yu, Huming Qiu, Dubing Chen, Haofeng Zhang arXiv_CV arXiv_CV Image_Caption Unsupervised Pose Contrastive_Learning Relation Attention PDF
2022-09-28 Medical Image Captioning via Generative Pretrained Transformers Alexander Selivanov, Oleg Y. Rogov, Daniil Chesakov, Artem Shelmanov, Irina Fedulova, Dmitry V. Dylov arXiv_AI arXiv_AI Image_Caption Transformer Pose Medical Caption Language_Model PDF
2022-09-26 Word to Sentence Visual Semantic Similarity for Caption Generation: Lessons Learned Ahmed Sabir arXiv_CV arXiv_CV Image_Caption Pose Caption PDF
2022-09-26 Improving Document Image Understanding with Reinforcement Finetuning Bao-Sinh Nguyen, Dung Tien Le, Hieu M. Vu, Tuan Anh D. Nguyen, Minh-Tien Nguyen, Hung Le arXiv_CV arXiv_CV Image_Caption Reinforcement_Learning Action PDF
2022-09-21 Show, Interpret and Tell: Entity-aware Contextualised Image Captioning in Wikipedia Khanh Nguyen, Ali Furkan Biten, Andres Mafla, Lluis Gomez, Dimosthenis Karatzas arXiv_CV arXiv_CV Image_Caption Transformer Knowledge Pose Caption PDF
2022-09-21 Toward 3D Spatial Reasoning for Human-like Text-based Visual Question Answering Hao Li, Jinfa Huang, Peng Jin, Guoli Song, Qi Wu, Jie Chen arXiv_CV arXiv_CV Image_Caption Transformer OCR 3D Knowledge Pose Scene_Text Face Relation VQA Attention Caption Prediction QA PDF
2022-09-19 Attentive Symmetric Autoencoder for Brain MRI Segmentation Junjia Huang, Haofeng Li, Guanbin Li, Xiang Wan arXiv_CV arXiv_CV Image_Caption Transformer Reconstruction Segmentation 3D Self-Supervised Pose Relation Attention Medical PDF
2022-09-19 On the Shift Invariance of Max Pooling Feature Maps in Convolutional Neural Networks Hubert Leterme (UGA, LJK), Kévin Polisano (UGA, LJK), Valérie Perrier (Grenoble INP, LJK), Karteek Alahari (LJK) arXiv_AI arXiv_AI Image_Caption Classification Relation CNN Image_Classification PDF
2022-09-17 Learning Distinct and Representative Modes for Image Captioning Qi Chen, Chaorui Deng, Qi Wu arXiv_CV arXiv_CV Image_Caption Transformer Embedding Pose Caption PDF
2022-09-16 Belief Revision based Caption Re-ranker with Visual Semantic Information Ahmed Sabir, Francesc Moreno-Noguer, Pranava Madhyastha, Lluís Padró arXiv_CV arXiv_CV Image_Caption Pose Caption PDF
2022-09-15 Can We Solve 3D Vision Tasks Starting from A 2D Vision Transformer? Yi Wang, Zhiwen Fan, Tianlong Chen, Hehe Fan, Zhangyang Wang arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Embedding Point_Cloud 3D Classification Detection PDF
2022-09-14 CLIP-ViP: Adapting Pre-trained Image-Text Model to Video-Language Representation Alignment Hongwei Xue, Yuchong Sun, Bei Liu, Jianlong Fu, Ruihua Song, Houqiang Li, Jiebo Luo arXiv_CV arXiv_CV Image_Caption Transformer Pose Activity PDF
2022-09-11 MAiVAR: Multimodal Audio-Image and Video Action Recognizer Muhammad Bilal Shaikh, Douglas Chai, Syed Mohammed Shamsul Islam, Naveed Akhtar arXiv_CV arXiv_CV Image_Caption Recognition Pose Action_Recognition Action PDF
2022-09-08 FETA: Towards Specializing Foundation Models for Expert Task Applications Amit Alfassy, Assaf Arbelle, Oshri Halimi, Sivan Harary, Roei Herzig, Eli Schwartz, Rameswar Panda, Michele Dolfi, Christoph Auer, Kate Saenko, PeterW. J. Staar, Rogerio Feris, Leonid Karlinsky arXiv_CV arXiv_CV Image_Caption Transformer Zero-Shot Pose Action PDF
2022-09-07 Neural Feature Fusion Fields: 3D Distillation of Self-Supervised 2D Image Representations Vadim Tschernezki, Iro Laina, Diane Larlus, Andrea Vedaldi arXiv_CV arXiv_CV Image_Caption Segmentation 3D Self-Supervised PDF
2022-09-07 Multi-Grained Angle Representation for Remote Sensing Object Detection Hao Wang, Zhanchao Huang, Zhengchao Chen, Ying Song, Wei Li arXiv_CV arXiv_CV Image_Caption Pose Face Classification Detection Object_Detection Prediction PDF
2022-09-06 Improving the Accuracy and Robustness of CNNs Using a Deep CCA Neural Data Regularizer Cassidy Pirlot, Richard C. Gerum, Cory Efird, Joel Zylberberg, Alona Fyshe arXiv_CV arXiv_CV Image_Caption Recognition Regularization Adversarial Classification Relation CNN PDF
2022-09-05 Design of the topology for contrastive visual-textual alignment Zhun Sun arXiv_CV arXiv_CV Image_Caption Transformer Embedding Zero-Shot Optimization Pose PDF
2022-09-05 Bridging Music and Text with Crowdsourced Music Comments: A Sequence-to-Sequence Framework for Thematic Music Comments Generation Peining Zhang, Junliang Guo, Linli Xu, Mu You, Junming Yin arXiv_CL arXiv_CL Image_Caption Pose Text_Generation Caption CNN PDF
2022-09-04 Every picture tells a story: Image-grounded controllable stylistic story generation Holy Lovenia, Bryan Wilie, Romain Barraud, Samuel Cahyawijaya, Willy Chung, Pascale Fung arXiv_CL arXiv_CL Image_Caption Pose Action Text_Generation Caption PDF
2022-09-04 Pseudo-LiDAR for Visual Odometry Huiying Deng, Guangming Wang, Zhiheng Feng, Chaokang Jiang, Xinrui Wu, Yanzi Miao, Hesheng Wang arXiv_RO arXiv_RO Image_Caption Point_Cloud 3D Sparse Knowledge Pose Matching PDF
2022-09-03 Label Structure Preserving Contrastive Embedding for Multi-Label Learning with Missing Labels Zhongchen Ma, Lisha Li, Qirong Mao, Songcan Chen arXiv_CV arXiv_CV Image_Caption Embedding Unsupervised Represenation_Learning Knowledge Pose Contrastive_Learning Classification GAN Image_Classification PDF
2022-09-03 vieCap4H-VLSP 2021: Vietnamese Image Captioning for Healthcare Domain using Swin Transformer and Attention-based LSTM Thanh Tin Nguyen, Long H. Nguyen, Nhat Truong Pham, Liu Tai Nguyen, Van Huong Do, Hai Nguyen, Ngoc Duy Nguyen arXiv_CV arXiv_CV Image_Caption Transformer RNN Speech Pose Attention Caption CNN PDF
2022-08-26 Few-Shot Learning Meets Transformer: Unified Query-Support Transformers for Few-Shot Classification Xixi Wang, Xiao Wang, Bo Jiang, Bin Luo arXiv_CV arXiv_CV Image_Caption Transformer Pose Classification Few-Shot Attention PDF
2022-08-25 Riesz-Quincunx-UNet Variational Auto-Encoder for Satellite Image Denoising Duy H. Thai, Xiqi Fei, Minh Tri Le, Andreas Züfle, Konrad Wessels arXiv_CV arXiv_CV Image_Caption Segmentation Pose Quantitative Deep_Learning Denoising Medical CNN PDF
2022-08-25 Multiresolution Neural Networks for Imaging Hallison Paz, Tiago Novello, Vinicius Silva, Luiz Schirmer, Guilherme Schardong, Luiz Velho arXiv_CV arXiv_CV Image_Caption Pose PDF
2022-08-23 IMPaSh: A Novel Domain-shift Resistant Representation for Colorectal Cancer Tissue Classification Trinh Thi Le Vuong, Quoc Dang Vu, Mostafa Jahanifar, Simon Graham, Jin Tae Kwak, Nasir Rajpoot arXiv_CV arXiv_CV Image_Caption Transformer Self-Supervised Pose Contrastive_Learning Classification Deep_Learning PDF
2022-08-22 Image as a Foreign Language: BEiT Pretraining for All Vision and Vision-Language Tasks Wenhui Wang, Hangbo Bao, Li Dong, Johan Bjorck, Zhiliang Peng, Qiang Liu, Kriti Aggarwal, Owais Khan Mohammed, Saksham Singhal, Subhojit Som, Furu Wei arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Semantic_Segmentation Pose Classification Detection VQA Object_Detection Caption Image_Classification QA PDF
2022-08-22 A Medical Semantic-Assisted Transformer for Radiographic Report Generation Zhanyu Wang, Mingkang Tang, Lei Wang, Xiu Li, Luping Zhou arXiv_CV arXiv_CV Image_Caption Transformer Sparse Pose Action Attention Medical Caption PDF
2022-08-19 Aspect-based Sentiment Classification with Sequential Cross-modal Semantic Graph Yufeng Huang, Zhuo Chen, Wen Zhang, Jiaoyan Chen, Jeff Z. Pan, Zhen Yao, Yujie Xie, Huajun Chen arXiv_CV arXiv_CV Image_Caption Sentiment_Classification Pose Classification Relation Sentiment Caption PDF
2022-08-18 VAuLT: Augmenting the Vision-and-Language Transformer with the Propagation of Deep Language Representations Georgios Chochlakis, Tejas Srinivasan, Jesse Thomason, Shrikanth Narayanan (University of Southern California) arXiv_CV arXiv_CV Image_Caption Transformer Bert Pose Relation Caption Inference Language_Model PDF
2022-08-18 GSRFormer: Grounded Situation Recognition Transformer with Alternate Semantic Attention Refinement Zhi-Qi Cheng, Qi Dai, Siyao Li, Teruko Mitamura, Alexander Hauptmann arXiv_CV arXiv_CV Image_Caption Transformer Recognition Salient Pose Detection Relation Object_Detection Attention Caption Activity PDF
2022-08-18 Discovering Bugs in Vision Models using Off-the-shelf Image Generation and Captioning Olivia Wiles, Isabela Albuquerque, Sven Gowal arXiv_CV arXiv_CV Image_Caption Adversarial Relation Caption PDF
2022-08-18 Towards Label-efficient Automatic Diagnosis and Analysis: A Comprehensive Survey of Advanced Deep Learning-based Weakly-supervised, Semi-supervised and Self-supervised Techniques in Histopathological Image Analysis Linhao Qu, Siyu Liu, Xiaoyu Liu, Manning Wang, Zhijian Song arXiv_CV arXiv_CV Image_Caption Weakly_Supervised Represenation_Learning Review Self-Supervised Survey Deep_Learning CNN Prediction PDF
2022-08-17 ILLUME: Rationalizing Vision-Language Models by Interacting with their Jabber Manuel Brac, Patrick Schramowski, Björn Deiseroth, Kristian Kersting arXiv_CV arXiv_CV Image_Caption Transformer Pose VQA Caption Language_Model PDF
2022-08-17 Boosting Modern and Historical Handwritten Text Recognition with Deformable Convolutions Silvia Cascianelli, Marcella Cornia, Lorenzo Baraldi, Rita Cucchiara arXiv_CV arXiv_CV Image_Caption Recognition Pose Action CNN PDF
2022-08-15 C3-DINO: Joint Contrastive and Non-contrastive Self-Supervised Learning for Speaker Verification Chunlei Zhang, Dong Yu arXiv_SD arXiv_SD Image_Caption Embedding Speech Self-Supervised Pose Contrastive_Learning Attention PDF
2022-08-13 ExpansionNet v2: Block Static Expansion in fast end to end training for Image Captioning Jia Cheng Hu, Roberto Cavicchioli, Alessandro Capotondi arXiv_CV arXiv_CV Image_Caption Deep_Learning Caption PDF
2022-08-12 BEiT v2: Masked Image Modeling with Vector-Quantized Visual Tokenizers Zhiliang Peng, Li Dong, Hangbo Bao, Qixiang Ye, Furu Wei arXiv_CV arXiv_CV Image_Caption Transformer Reconstruction Segmentation Semantic_Segmentation Represenation_Learning Knowledge Self-Supervised Pose Classification Image_Classification Prediction PDF
2022-08-12 Facial Expression Recognition and Image Description Generation in Vietnamese Khang Nhut Lam, Kim-Ngoc Thi Nguyen, Loc Huu Nguy, Jugal Kalita arXiv_CV arXiv_CV Image_Caption Recognition RNN Pose Emotion PDF
2022-08-09 Automatic Ultrasound Image Segmentation of Supraclavicular Nerve Using Dilated U-Net Deep Learning Architecture Mizuki Miyatake, Subhash Nerella, David Simpson, Natalia Pawlowicz, Sarah Stern, Patrick Tighe, Parisa Rashidi arXiv_CV arXiv_CV Image_Caption Segmentation Recognition Deep_Learning Detection Medical PDF
2022-08-09 Aesthetic Attributes Assessment of Images with AMANv2 and DPC-CaptionsV2 Xinghui Zhou, Xin Jin, Jianwen Lv, Heng Huang, Ming Mao, Shuai Cui arXiv_CV arXiv_CV Image_Caption Transformer RNN Knowledge Pose Caption PDF
2022-08-08 Semi-Supervised Cross-Modal Salient Object Detection with U-Structure Networks Yunqing Bao, Hang Dai, Abdulmotaleb Elsaddik arXiv_CV arXiv_CV Image_Caption Segmentation Salient Pose Detection Object_Detection Attention Caption PDF
2022-08-08 Distincive Image Captioning via CLIP Guided Group Optimization Youyuan Zhang, Jiuniu Wang, Hao Wu, Wenjia Xu arXiv_CV arXiv_CV Image_Caption Transformer Optimization Pose Caption PDF
2022-08-08 Analog Bits: Generating Discrete Data using Diffusion Models with Self-Conditioning Ting Chen, Ruixiang Zhang, Geoffrey Hinton arXiv_AI arXiv_AI Image_Caption Pose Caption PDF
2022-08-07 Adaptive Local Implicit Image Function for Arbitrary-scale Super-resolution Hongwei Li, Tao Dai, Yiming Li, Xueyi Zou, Shu-Tao Xia arXiv_AI arXiv_AI Image_Caption Super_Resolution Pose PDF
2022-08-06 Deep Uncalibrated Photometric Stereo via Inter-Intra Image Feature Fusion Fangzhou Gao, Meng Wang, Lianghao Zhang, Li Wang, Jiawan Zhang arXiv_CV arXiv_CV Image_Caption Optimization Pose Face Action Deep_Learning PDF
2022-08-05 RadTex: Learning Efficient Radiograph Representations from Text Reports Keegan Quigley, Miriam Cha, Ruizhi Liao, Geeticka Chauhan, Steven Horng, Seth Berkowitz, Polina Golland arXiv_CV arXiv_CV Image_Caption Transformer Classification Deep_Learning Medical Caption CNN Image_Classification PDF
2022-08-05 ChiQA: A Large Scale Image-based Real-World Question Answering Dataset for Multi-Modal Understanding Bingning Wang, Feiyang Lv, Ting Yao, Yiming Yuan, Jin Ma, Yu Luo, Haijin Liang arXiv_CV arXiv_CV Image_Caption VQA Caption Language_Model QA PDF
2022-08-04 MVSFormer: Learning Robust Image Representations via Transformers and Temperature-based Depth for Multi-View Stereo Chenjie Cao, Xinlin Ren, Yanwei Fu arXiv_CV arXiv_CV Image_Caption Transformer Represenation_Learning Pose Classification CNN PDF
2022-07-31 Neuro-Symbolic Learning: Principles and Applications in Ophthalmology Muhammad Hassan, Haifei Guan, Aikaterini Melliou, Yuqi Wang, Qianhui Sun, Sen Zeng, Wen Liang, Yiwei Zhang, Ziheng Zhang, Qiuyue Hu, Yang Liu, Shunkai Shi, Lin An, Shuyue Ma, Ijaz Gul, Muhammad Akmal Rahee, Zhou You, Canyang Zhang, Vijay Kumar Pandey, Yuxing Han, Yongbing Zhang, Ming Xu, Qiming Huang, Jiefu Tan, Qi Xing, Peiwu Qin, Dongmei Yu arXiv_AI arXiv_AI Image_Caption Embedding Knowledge Review Survey Deep_Learning Caption PDF
2022-07-29 High Dynamic Range and Super-Resolution from Raw Image Bursts Bruno Lecouat, Thomas Eboli, Jean Ponce, Julien Mairal arXiv_CV arXiv_CV Image_Caption Reconstruction Super_Resolution Restoration Optimization Knowledge Pose PDF
2022-07-29 Paired Cross-Modal Data Augmentation for Fine-Grained Image-to-Text Retrieval Hao Wang, Guosheng Lin, Steven C. H. Hoi, Chunyan Miao arXiv_CV arXiv_CV Image_Caption Pose GAN Caption PDF
2022-07-28 Separable Quaternion Matrix Factorization for Polarization Images Junjun Pan, Michael K. Ng arXiv_CV arXiv_CV Image_Caption Pose PDF
2022-07-28 Self-supervised learning with rotation-invariant kernels Léon Zheng (DANTE), Gilles Puy, Elisa Riccietti (DANTE), Patrick Pérez, Rémi Gribonval (DANTE) arXiv_AI arXiv_AI Image_Caption Embedding Regularization Self-Supervised Pose PDF
2022-07-27 D3C2-Net: Dual-Domain Deep Convolutional Coding Network for Compressive Sensing Weiqi Li, Bin Chen, Jian Zhang arXiv_CV arXiv_CV Image_Caption Optimization Pose Compressive_Sensing CNN PDF
2022-07-26 Retrieval-Augmented Transformer for Image Captioning Sara Sarto, Marcella Cornia, Lorenzo Baraldi, Rita Cucchiara arXiv_AI arXiv_AI Image_Caption Transformer Knowledge Action Attention Caption PDF
2022-07-26 Unsupervised Contrastive Learning of Image Representations from Ultrasound Videos with Hard Negative Mining Soumen Basu, Somanshu Singla, Mayank Gupta, Pratyaksha Rana, Pankaj Gupta, Chetan Arora arXiv_CV arXiv_CV Image_Caption Embedding Unsupervised Pose Contrastive_Learning Detection GAN PDF
2022-07-23 Arbitrary Style Transfer with Structure Enhancement by Combining the Global and Local Loss Lizhen Long, Chi-Man Pun arXiv_CV arXiv_CV Image_Caption Style_Transfer Enhancement Classification PDF
2022-07-22 Rethinking the Reference-based Distinctive Image Captioning Yangjun Mao, Long Chen, Zhihong Jiang, Dong Zhang, Zhimeng Zhang, Jian Shao, Jun Xiao arXiv_CV arXiv_CV Image_Caption Transformer Pose Attention Caption Matching PDF
2022-07-22 Zero-Shot Video Captioning with Evolving Pseudo-Tokens Yoad Tewel, Yoav Shalev, Roy Nadler, Idan Schwartz, Lior Wolf arXiv_CV arXiv_CV Image_Caption Video_Caption Zero-Shot Knowledge Caption Language_Model Matching PDF
2022-07-22 Efficient Modeling of Future Context for Image Captioning Zhengcong Fei, Junshi Huang, Xiaoming Wei, Xiaolin Wei arXiv_CV arXiv_CV Image_Caption Pose Relation Caption Inference PDF
2022-07-20 GRIT: Faster and Better Image captioning Transformer Using Dual Visual Features Van-Quang Nguyen, Masanori Suganuma, Takayuki Okatani arXiv_AI arXiv_AI Image_Caption Transformer Pose Detection Object_Detection Caption Inference PDF
2022-07-20 Explicit Image Caption Editing Zhen Wang, Long Chen, Wenbo Ma, Guangxing Han, Yulei Niu, Jian Shao, Jun Xiao arXiv_CV arXiv_CV Image_Caption Transformer Pose GAN Caption PDF
2022-07-19 Shrinking the Semantic Gap: Spatial Pooling of Local Moment Invariants for Copy-Move Forgery Detection Chao Wang, Zhiqiu Huang, Shuren Qi, Yaoshen Yu, Guohua Shen arXiv_CV arXiv_CV Image_Caption Salient Pose Detection Matching PDF
2022-07-18 Open-world Semantic Segmentation via Contrasting and Clustering Vision-Language Embedding Quande Liu, Youpeng Wen, Jianhua Han, Chunjing Xu, Hang Xu, Xiaodan Liang arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Embedding Semantic_Segmentation Zero-Shot Pose Relation Attention Caption PDF
2022-07-16 Dual-branch Hybrid Learning Network for Unbiased Scene Graph Generation Chaofan Zheng, Lianli Gao, Xinyu Lyu, Pengpeng Zeng, Abdulmotaleb El Saddik, Heng Tao Shen arXiv_CV arXiv_CV Image_Caption Pose Caption Inference QA PDF
2022-07-15 LineCap: Line Charts for Data Visualization Captioning Models Anita Mahinpei, Zona Kostic, Chris Tanner arXiv_CV arXiv_CV Image_Caption Pose Deep_Learning Caption PDF
2022-07-12 Camera Pose Auto-Encoders for Improving Pose Regression Yoli Shavit, Yosi Keller arXiv_AI arXiv_AI Image_Caption Optimization Pose PDF
2022-07-12 Skeletal Human Action Recognition using Hybrid Attention based Graph Convolutional Network Hao Xing, Darius Burschka arXiv_CV arXiv_CV Image_Caption Recognition Pose Action_Recognition Action Relation Attention CNN PDF
2022-07-12 A Baseline for Detecting Out-of-Distribution Examples in Image Captioning Gabi Shalev, Gal-Lev Shalev, Joseph Keshet arXiv_CV arXiv_CV Image_Caption Detection Caption PDF
2022-07-12 Towards Hard-Positive Query Mining for DETR-based Human-Object Interaction Detection Xubin Zhong, Changxing Ding, Zijian Li, Shaoli Huang arXiv_CV arXiv_CV Image_Caption Transformer Pose Action Detection Object_Detection Attention Prediction PDF
2022-07-11 Adaptive Fine-Grained Predicates Learning for Scene Graph Generation Xinyu Lyu, Lianli Gao, Pengpeng Zeng, Heng Tao Shen, Jingkuan Song arXiv_AI arXiv_AI Image_Caption Pose Classification Relation Caption Image_Classification Prediction QA PDF
2022-07-09 A Study on Self-Supervised Object Detection Pretraining Trung Dang, Simon Kornblith, Huy Thong Nguyen, Peter Chin, Maryam Khademi arXiv_CV arXiv_CV Image_Caption Transformer Represenation_Learning Self-Supervised Action Detection Object_Detection PDF
2022-07-09 Towards Multimodal Vision-Language Models Generating Non-Generic Text Wes Robbins, Zanyar Zohourianshahzadi, Jugal Kalita arXiv_AI arXiv_AI Image_Caption Transformer Recognition Optical_Character Caption Language_Model PDF
2022-07-07 ExpansionNet: exploring the sequence length bottleneck in the Transformer for Image Captioning Jia Cheng Hu arXiv_CV arXiv_CV Image_Caption Transformer Pose Caption CNN PDF
2022-07-07 Deformer: Towards Displacement Field Learning for Unsupervised Medical Image Registration Jiashun Chen, Donghuan Lu, Yu Zhang, Dong Wei, Munan Ning, Xinyu Shi, Zhe Xu, Yefeng Zheng arXiv_CV arXiv_CV Image_Caption Transformer Unsupervised Pose Relation Attention Medical CNN Prediction PDF
2022-07-07 Improving Few-Shot Image Classification Using Machine- and User-Generated Natural Language Descriptions Kosuke Nishida, Kyosuke Nishida, Shuichi Nishioka arXiv_CV arXiv_CV Image_Caption Knowledge Pose Classification Few-Shot Image_Classification Prediction PDF
2022-07-05 TractoFormer: A Novel Fiber-level Whole Brain Tractography Analysis Framework Using Spectral Embedding and Vision Transformers Fan Zhang, Tengfei Xue, Weidong Cai, Yogesh Rathi, Carl-Fredrik Westin, Lauren J O'Donnell arXiv_CV arXiv_CV Image_Caption Transformer Embedding 3D Pose Quantitative Classification Relation Attention PDF
2022-07-05 Detecting and Recovering Sequential DeepFake Manipulation Rui Shao, Tianxing Wu, Ziwei Liu arXiv_CV arXiv_CV Image_Caption Transformer Pose Face Detection Caption Prediction PDF
2022-07-04 Are metrics measuring what they should? An evaluation of image captioning task metrics Othón González-Chávez, Guillermo Ruiz, Daniela Moctezuma, Tania A. Ramirez-delReal arXiv_CV arXiv_CV Image_Caption Relation Caption PDF
2022-07-02 Contrastive Cross-Modal Knowledge Sharing Pre-training for Vision-Language Representation Learning and Retrieval Keyu Wen, Zhenshan Tan, Qingrong Cheng, Cheng Chen, Xiaodong Gu arXiv_AI arXiv_AI Image_Caption Transformer Represenation_Learning Image_Retrieval Knowledge Contrastive_Learning Action Caption Matching PDF
2022-07-01 American == White in Multimodal Language-and-Image AI Robert Wolfe, Aylin Caliskan arXiv_AI arXiv_AI Image_Caption Embedding Face VQA GAN Caption PDF
2022-06-30 Rethinking Surgical Captioning: End-to-End Window-Based MLP Transformer Using Patches Mengya Xu, Mobarakol Islam, Hongliang Ren arXiv_CV arXiv_CV Image_Caption Transformer Video_Caption 3D Pose Detection Object_Detection Attention Caption Inference Prediction PDF
2022-06-28 ZoDIAC: Zoneout Dropout Injection Attention Calculation Zanyar Zohourianshahzadi, Jugal Kalita arXiv_CV arXiv_CV Image_Caption Transformer Pose Face Action Classification Relation Attention Caption Image_Classification PDF
2022-06-27 Parameter-Efficient Image-to-Video Transfer Learning Junting Pan, Ziyi Lin, Xiatian Zhu, Jing Shao, Hongsheng Li arXiv_CV arXiv_CV Image_Caption Transfer_Learning Recognition Video_Caption Knowledge Pose Action_Recognition Action PDF
2022-06-27 Lesion-Aware Contrastive Representation Learning for Histopathology Whole Slide Images Analysis Jun Li, Yushan Zheng, Kun Wu, Jun Shi, Fengying Xie, Zhiguo Jiang arXiv_CV arXiv_CV Image_Caption Represenation_Learning Self-Supervised Pose Contrastive_Learning Classification Attention PDF
2022-06-24 Competence-based Multimodal Curriculum Learning for Medical Report Generation Fenglin Liu, Shen Ge, Xian Wu arXiv_CV arXiv_CV Image_Caption Pose Medical Caption PDF
2022-06-24 Deep embedded clustering algorithm for clustering PACS repositories Teo Manojlović, Matija Milanič, Ivan Štajduhar arXiv_CV arXiv_CV Image_Caption Embedding Unsupervised Action Medical CNN PDF
2022-06-21 Transformer-Based Multi-modal Proposal and Re-Rank for Wikipedia Image-Caption Matching Nicola Messina, Davide Alessandro Coccomini, Andrea Esuli, Fabrizio Falchi arXiv_CV arXiv_CV Image_Caption Transformer Pose Caption Inference Matching PDF
2022-06-21 SemMAE: Semantic-Guided Masking for Learning Masked Autoencoders Gang Li, Heliang Zheng, Daqing Liu, Bing Su, Changwen Zheng arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation Recognition Self-Supervised Relation Attention Language_Model PDF
2022-06-21 KTN: Knowledge Transfer Network for Learning Multi-person 2D-3D Correspondences Xuanhan Wang, Lianli Gao, Yixuan Zhou, Jingkuan Song, Meng Wang arXiv_CV arXiv_CV Image_Caption Segmentation 3D Pose_Estimation Knowledge Knowledge_Graph Pose Detection CNN PDF
2022-06-20 DALL-E for Detection: Language-driven Context Image Synthesis for Object Detection Yunhao Ge, Jiashu Xu, Brian Nlong Zhao, Laurent Itti, Vibhav Vineet arXiv_CV arXiv_CV Image_Caption Recognition Zero-Shot Pose Detection Object_Detection Caption PDF
2022-06-19 A Self-Guided Framework for Radiology Report Generation Jun Li, Shibo Li, Ying Hu, Huiren Tao arXiv_CV arXiv_CV Image_Caption Unsupervised Knowledge Pose Deep_Learning Medical Caption PDF
2022-06-19 What is Where by Looking: Weakly-Supervised Open-World Phrase-Grounding without Text Inputs Tal Shaharabany, Yoad Tewel, Lior Wolf arXiv_CV arXiv_CV Image_Caption Segmentation Weakly_Supervised Caption Inference Matching PDF
2022-06-17 Intra-Instance VICReg: Bag of Self-Supervised Image Patch Embedding Yubei Chen, Adrien Bardes, Zengyi Li, Yann LeCun arXiv_CV arXiv_CV Image_Caption Embedding Knowledge Self-Supervised Pose PDF
2022-06-16 Beyond Supervised vs. Unsupervised: Representative Benchmarking and Analysis of Image Representation Learning Matthew Gwilliam, Abhinav Shrivastava arXiv_CV arXiv_CV Image_Caption Embedding Unsupervised Represenation_Learning Pose Contrastive_Learning Classification Prediction PDF
2022-06-16 Channel Importance Matters in Few-Shot Image Classification Xu Luo, Jing Xu, Zenglin Xu arXiv_CV arXiv_CV Image_Caption Pose Classification Few-Shot Attention CNN Image_Classification PDF
2022-06-16 Image Captioning based on Feature Refinement and Reflective Decoding Ghadah Alabduljabbar, Hafida Benhidour, Said Kerrache arXiv_CV arXiv_CV Image_Caption Salient Pose Action Deep_Learning Attention Caption PDF
2022-06-15 A Unified Sequence Interface for Vision Tasks Ting Chen, Saurabh Saxena, Lala Li, Tsung-Yi Lin, David J. Fleet, Geoffrey Hinton arXiv_CV arXiv_CV Image_Caption Segmentation Face Detection Object_Detection Caption PDF
2022-06-15 Coarse-to-Fine Vision-Language Pre-training with Fusion in the Backbone Zi-Yi Dou, Aishwarya Kamath, Zhe Gan, Pengchuan Zhang, Jianfeng Wang, Linjie Li, Zicheng Liu, Ce Liu, Yann LeCun, Nanyun Peng, Jianfeng Gao, Lijuan Wang arXiv_CV arXiv_CV Image_Caption Transformer Detection VQA Object_Detection Attention Caption QA PDF
2022-06-15 Recent Advances in Scene Image Representation and Classification Chiranjibi Sitaula, Tej Bahadur Shahi, Faezeh Marzbanrad arXiv_CV arXiv_CV Image_Caption Review Pose Survey Quantitative Classification Deep_Learning Image_Classification PDF
2022-06-14 Measuring Representational Harms in Image Captioning Angelina Wang, Solon Barocas, Kristen Laird, Hanna Wallach arXiv_CV arXiv_CV Image_Caption Pose Face Caption PDF
2022-06-14 Self-Supervision on Images and Text Reduces Reliance on Visual Shortcut Features Anil Palepu, Andrew L Beam arXiv_CV arXiv_CV Image_Caption Self-Supervised Deep_Learning Medical PDF
2022-06-14 ReCo: Retrieve and Co-segment for Zero-shot Transfer Gyungin Shin, Weidi Xie, Samuel Albanie arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Unsupervised Semantic_Segmentation Zero-Shot Knowledge Classification Prediction PDF
2022-06-14 Comprehending and Ordering Semantics for Image Captioning Yehao Li, Yingwei Pan, Ting Yao, Tao Mei arXiv_CL arXiv_CL Image_Caption Transformer Pose Detection Object_Detection Caption PDF
2022-06-12 GLIPv2: Unifying Localization and Vision-Language Understanding Haotian Zhang, Pengchuan Zhang, Xiaowei Hu, Yen-Chun Chen, Liunian Harold Li, Xiyang Dai, Lijuan Wang, Lu Yuan, Jenq-Neng Hwang, Jianfeng Gao arXiv_AI arXiv_AI Image_Caption Transformer Segmentation Zero-Shot Contrastive_Learning Detection VQA Few-Shot Object_Detection GAN Caption Language_Model QA PDF
2022-06-10 Zero-Shot Audio Classification using Image Embeddings Duygu Dogan, Huang Xie, Toni Heittola, Tuomas Virtanen arXiv_SD arXiv_SD Image_Caption Embedding Zero-Shot Classification Relation PDF
2022-06-09 SAR Despeckling using a Denoising Diffusion Probabilistic Model Malsha V. Perera, Nithin Gopalakrishnan Nair, Wele Gedara Chaminda Bandara, Vishal M. Patel arXiv_CV arXiv_CV Image_Caption Recognition Pose Quantitative Detection Denoising Inference PDF
2022-06-07 Improving Image Captioning with Control Signal of Sentence Quality Zhangzi Zhu, Hong Qu arXiv_CV arXiv_CV Image_Caption Pose Caption PDF
2022-06-07 Intra-agent speech permits zero-shot task acquisition Chen Yan, Federico Carnevale, Petko Georgiev, Adam Santoro, Aurelia Guy, Alistair Muldal, Chia-Chun Hung, Josh Abramson, Timothy Lillicrap, Gregory Wayne arXiv_AI arXiv_AI Image_Caption 3D Zero-Shot Speech Pose Action Caption PDF
2022-06-06 Scaling Vision Transformers to Gigapixel Images via Hierarchical Self-Supervised Learning Richard J. Chen, Chengkuan Chen, Yicong Li, Tiffany Y. Chen, Andrew D. Trister, Rahul G. Krishnan, Faisal Mahmood arXiv_CV arXiv_CV Image_Caption Transformer Self-Supervised Action Prediction PDF
2022-06-03 On the duality between contrastive and non-contrastive self-supervised learning Quentin Garrido (FAIR, LIGM), Yubei Chen (FAIR), Adrien Bardes (FAIR, WILLOW), Laurent Najman (LIGM), Yann Lecun (FAIR, CIMS) arXiv_AI arXiv_AI Image_Caption Optimization Self-Supervised Quantitative PDF
2022-06-02 3D-Augmented Contrastive Knowledge Distillation for Image-based Object Pose Estimation Zhidan Liu, Zhen Xing, Xiangdong Zhou, Yijiang Chen, Guichun Zhou arXiv_AI arXiv_AI Image_Caption 3D Pose_Estimation Knowledge Pose Contrastive_Learning PDF
2022-06-02 Prefix Conditioning Unifies Language and Label Supervision Kuniaki Saito, Kihyuk Sohn, Xiang Zhang, Chun-Liang Li, Chen-Yu Lee, Kate Saenko, Tomas Pfister arXiv_CV arXiv_CV Image_Caption Transformer Recognition Zero-Shot Pose Contrastive_Learning Caption PDF
2022-06-01 Cross-View Language Modeling: Towards Unified Cross-Lingual Cross-Modal Pre-training Yan Zeng, Wangchunshu Zhou, Ao Luo, Xinsong Zhang arXiv_AI arXiv_AI Image_Caption Transformer Zero-Shot Contrastive_Learning Caption Language_Model PDF
2022-06-01 Dog nose print matching with dual global descriptor based on Contrastive Learning Bin Li, Zhongan Wang, Nan Wu, Shuai Shi, Qijun Ma arXiv_CV arXiv_CV Image_Caption Pose Contrastive_Learning Deep_Learning Matching PDF
2022-06-01 The Fully Convolutional Transformer for Medical Image Segmentation Athanasios Tragakis, Chaitanya Kaul, Roderick Murray-Smith, Dirk Husmeier arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Pose Medical CNN PDF
2022-06-01 Visual Transformer for Object Detection Michael Yang arXiv_CV arXiv_CV Image_Caption Transformer Pose Action Detection Object_Detection Attention Caption CNN PDF
2022-05-31 Unsupervised Image Representation Learning with Deep Latent Particles Tal Daniel, Aviv Tamar arXiv_AI arXiv_AI Image_Caption Unsupervised Represenation_Learning Video_Prediction Pose Detection Prediction PDF
2022-05-30 Self-Supervised Pre-training of Vision Transformers for Dense Prediction Tasks Jaonary Rabarisoa, Velentin Belissen, Florian Chabot, Quoc-Cuong Pham arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Semantic_Segmentation Self-Supervised Pose Prediction PDF
2022-05-28 BAN-Cap: A Multi-Purpose English-Bangla Image Descriptions Dataset Mohammad Faiyaz Khan, S.M. Sadiq-Ur-Rahman Shifath, Md Saiful Islam arXiv_CL arXiv_CL Image_Caption Pose Quantitative Attention Caption PDF
2022-05-28 Variational Transformer: A Framework Beyond the Trade-off between Accuracy and Diversity for Image Captioning Longzhen Yang, Shaohua Shang, Yihang Liu, Yitao Peng, Lianghua He arXiv_CV arXiv_CV Image_Caption Transformer Pose Relation Caption PDF
2022-05-27 GIT: A Generative Image-to-text Transformer for Vision and Language Jianfeng Wang, Zhengyuan Yang, Xiaowei Hu, Linjie Li, Kevin Lin, Zhe Gan, Zicheng Liu, Ce Liu, Lijuan Wang arXiv_CV arXiv_CV Image_Caption Transformer Recognition Video_Caption OCR Optical_Character Scene_Text Classification Detection Object_Detection Caption Image_Classification Language_Model PDF
2022-05-27 TraClets: Harnessing the power of computer vision for trajectory classification Ioannis Kontopoulos, Antonios Makris, Konstantinos Tserpes, Vania Bogorny arXiv_CV arXiv_CV Image_Caption Tracking Pose Classification PDF
2022-05-26 HIRL: A General Framework for Hierarchical Image Representation Learning Minghao Xu, Yuanfan Guo, Xuanyu Zhu, Jiawen Li, Zhenbang Sun, Jian Tang, Yi Xu, Bingbing Ni arXiv_CV arXiv_CV Image_Caption Represenation_Learning Self-Supervised Pose PDF
2022-05-26 Prompt-based Learning for Unpaired Image Captioning Peipei Zhu, Xiao Wang, Lin Zhu, Zhenglong Sun, Weishi Zheng, Yaowei Wang, Changwen Chen arXiv_CV arXiv_CV Image_Caption Transformer Reinforcement_Learning Knowledge Adversarial Pose Action Relation Caption PDF
2022-05-26 Fine-grained Image Captioning with CLIP Reward Jaemin Cho, Seunghyun Yoon, Ajinkya Kale, Franck Dernoncourt, Trung Bui, Mohit Bansal arXiv_AI arXiv_AI Image_Caption Unsupervised Image_Retrieval Salient Pose Relation Caption PDF
2022-05-25 Mutual Information Divergence: A Unified Metric for Multimodal Generative Models Jin-Hwa Kim, Yunji Kim, Jiyoung Lee, Kang Min Yoo, Sang-Woo Lee arXiv_AI arXiv_AI Image_Caption Represenation_Learning Pose Caption PDF
2022-05-25 Crossmodal-3600: A Massively Multilingual Multimodal Evaluation Dataset Ashish V. Thapliyal, Jordi Pont-Tuset, Xi Chen, Radu Soricut arXiv_CV arXiv_CV Image_Caption Relation Caption PDF
2022-05-24 Face2Text revisited: Improved data set and baseline results Marc Tanti, Shaun Abdilla, Adrian Muscat, Claudia Borg, Reuben A. Farrugia, Albert Gatt arXiv_CV arXiv_CV Image_Caption Transfer_Learning RNN Face Attention PDF
2022-05-24 Rethinking Evaluation Practices in Visual Question Answering: A Case Study on Out-of-Distribution Generalization Aishwarya Agrawal, Ivana Kajić, Emanuele Bugliarello, Elnaz Davoodi, Anita Gergely, Phil Blunsom, Aida Nematzadeh arXiv_AI arXiv_AI Image_Caption Classification VQA Text_Generation Caption QA PDF
2022-05-24 mPLUG: Effective and Efficient Vision-Language Learning by Cross-modal Skip-connections Chenliang Li, Haiyang Xu, Junfeng Tian, Wei Wang, Ming Yan, Bin Bi, Jiabo Ye, Hehong Chen, Guohai Xu, Zheng Cao, Ji Zhang, Songfang Huang, Fei Huang, Jingren Zhou arXiv_CV arXiv_CV Image_Caption Transformer Zero-Shot VQA Attention Caption PDF
2022-05-24 Symbolic Expression Transformer: A Computer Vision Approach for Symbolic Regression Jiachen Li, Ye Yuan, Hong-Bin Shen arXiv_AI arXiv_AI Image_Caption Transformer Pose Caption PDF
2022-05-24 On Advances in Text Generation from Images Beyond Captioning: A Case Study in Self-Rationalization Shruti Palaskar, Akshita Bhagia, Yonatan Bisk, Florian Metze, Alan W Black, Ana Marasovic arXiv_CV arXiv_CV Image_Caption Action VQA Attention Text_Generation Caption Language_Model QA PDF
2022-05-23 Saliency-Driven Active Contour Model for Image Segmentation Ehtesham Iqbal, Asim Niaz, Asif Aziz Memon, Usman Asim, Kwang Nam Choi arXiv_CV arXiv_CV Image_Caption Segmentation Salient Pose Face Quantitative Contour Medical PDF
2022-05-21 Context Matters for Image Descriptions for Accessibility: Challenges for Referenceless Evaluation Metrics Elisa Kreiss, Cynthia Bennett, Shayan Hooshmand, Eric Zelikman, Meredith Ringel Morris, Christopher Potts arXiv_CL arXiv_CL Image_Caption PDF
2022-05-20 PGDP5K: A Diagram Parsing Dataset for Plane Geometry Problems Yihan Hao (1 and 2), Mingliang Zhang (2 and 3), Fei Yin (2 and 3), Linlin Huang (1) ((1) Beijing Jiaotong University, (2) Institute of Automation of Chinese Academy of Science, (3) University of Chinese Academy of Sciences) arXiv_CV arXiv_CV Image_Caption Knowledge Pose Relation Attention PDF
2022-05-18 Financial Time Series Data Augmentation with Generative Adversarial Networks and extended Intertemporal Return Plots Justin Hellermann, Qinzhuan Qian, Ankit Shah arXiv_CV arXiv_CV Image_Caption Regularization Adversarial Classification Relation GAN PDF
2022-05-18 It Isn't Sh!tposting, It's My CAT Posting Parthsarthi Rawat, Sayan Das, Jorge Aguirre, Akhil Daphara arXiv_AI arXiv_AI Image_Caption Transformer RNN Attention Caption PDF
2022-05-14 Object-Aware Self-supervised Multi-Label Learning Xu Kaixin, Liu Liyang, Zhao Ziyuan, Zeng Zeng, Bharadwaj Veeravalli arXiv_CV arXiv_CV Image_Caption Self-Supervised Pose Classification Deep_Learning PDF
2022-05-12 Localized Vision-Language Matching for Open-vocabulary Object Detection Maria A. Bravo, Sudhanshu Mittal, Thomas Brox arXiv_CV arXiv_CV Image_Caption Transformer Regularization Pose Detection Object_Detection Caption Language_Model Matching PDF
2022-05-12 A Computational Acquisition Model for Multimodal Word Categorization Uri Berger, Gabriel Stanovsky, Omri Abend, Lea Frermann arXiv_CL arXiv_CL Image_Caption Recognition Self-Supervised Pose Caption PDF
2022-05-11 CV4Code: Sourcecode Understanding via Visual Code Representations Ruibo Shi, Lili Tao, Rohan Saphal, Fran Silavong, Sean J. Moran arXiv_AI arXiv_AI Image_Caption Transformer Embedding Pose CNN PDF
2022-05-09 Beyond a Pre-Trained Object Detector: Cross-Modal Textual and Visual Context for Image Captioning Chia-Wen Kuo, Zsolt Kira arXiv_AI arXiv_AI Image_Caption Pose Quantitative Detection Relation Object_Detection Caption PDF
2022-05-07 GenISP: Neural ISP for Low-Light Machine Cognition Igor Morawski, Yu-An Chen, Yu-Sheng Lin, Shusil Dangi, Kai He, Winston H. Hsu arXiv_CV arXiv_CV Image_Caption Enhancement Restoration Pose Detection Object_Detection Inference PDF
2022-05-05 Language Models Can See: Plugging Visual Controls in Text Generation Yixuan Su, Tian Lan, Yahui Liu, Fangyu Liu, Dani Yogatama, Yan Wang, Lingpeng Kong, Nigel Collier arXiv_CV arXiv_CV Image_Caption Zero-Shot Pose Text_Generation Caption Language_Model Matching PDF
2022-05-05 AdaTriplet: Adaptive Gradient Triplet Loss with Automatic Margin Learning for Forensic Medical Image Matching Khanh Nguyen, Huy Hoang Nguyen, Aleksei Tiulpin arXiv_CV arXiv_CV Image_Caption Image_Retrieval Pose Medical Matching PDF
2022-05-05 Understanding Transfer Learning for Chest Radiograph Clinical Report Generation with Modified Transformer Architectures Edward Vendrow, Ethan Schonfeld arXiv_AI arXiv_AI Image_Caption Transformer Embedding Transfer_Learning Bert Pose Medical Caption PDF
2022-05-04 CoCa: Contrastive Captioners are Image-Text Foundation Models Jiahui Yu, Zirui Wang, Vijay Vasudevan, Legg Yeung, Mojtaba Seyedhosseini, Yonghui Wu arXiv_CV arXiv_CV Image_Caption Transformer Embedding Recognition Zero-Shot Represenation_Learning Classification VQA Attention Caption QA PDF
2022-05-04 All You May Need for VQA are Image Captions Soravit Changpinyo, Doron Kukliansky, Idan Szpektor, Xi Chen, Nan Ding, Radu Soricut arXiv_CV arXiv_CV Image_Caption Zero-Shot Pose VQA Caption QA PDF
2022-05-03 Diverse Image Captioning with Grounded Style Franz Klein, Shweta Mahajan, Stefan Roth arXiv_CV arXiv_CV Image_Caption Pose Sentiment Caption PDF
2022-05-02 Hausa Visual Genome: A Dataset for Multi-Modal English to Hausa Machine Translation Idris Abdulmumin, Satya Ranjan Dash, Musa Abdullahi Dawud, Shantipriya Parida, Shamsuddeen Hassan Muhammad, Ibrahim Sa'id Ahmad, Subhadarshi Panda, Ondřej Bojar, Bashir Shehu Galadanci, Bello Shehu Bello arXiv_CV arXiv_CV Image_Caption PDF
2022-05-02 Answer-Me: Multi-Task Open-Vocabulary Visual Question Answering AJ Piergiovanni, Wei Li, Weicheng Kuo, Mohammad Saffar, Fred Bertsch, Anelia Angelova arXiv_CV arXiv_CV Image_Caption Transformer Zero-Shot Pose VQA Caption QA PDF
2022-04-28 Keep the Caption Information: Preventing Shortcut Learning in Contrastive Image-Caption Retrieval Maurits Bleeker, Andrew Yates, Maarten de Rijke arXiv_AI arXiv_AI Image_Caption Reconstruction Optimization Caption PDF
2022-04-28 Controllable Image Captioning Luka Maxwell arXiv_CV arXiv_CV Image_Caption Transformer Speech Pose Caption PDF
2022-04-27 Self-Supervised Learning of Object Parts for Semantic Segmentation Adrian Ziegler, Yuki M. Asano arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Unsupervised Semantic_Segmentation Represenation_Learning Self-Supervised Pose Detection PDF
2022-04-27 CapOnImage: Context-driven Dense-Captioning on Image Yiqi Gao, Xinglin Hou, Yuanmeng Zhang, Tiezheng Ge, Yuning Jiang, Peng Wang arXiv_CV arXiv_CV Image_Caption Transformer Embedding Pose Caption PDF
2022-04-20 Self-supervised Learning for Sonar Image Classification Alan Preciado-Grijalva, Bilal Wehbe, Miguel Bande Firvida, Matias Valdenegro-Toro arXiv_CV arXiv_CV Image_Caption Transformer Transfer_Learning Self-Supervised Classification Few-Shot Denoising Image_Classification PDF
2022-04-20 Uncertainty-based Cross-Modal Retrieval with Probabilistic Representations Leila Pishdad, Ran Zhang, Konstantinos G. Derpanis, Allan Jepson, Afsaneh Fazly arXiv_CV arXiv_CV Image_Caption Embedding Image_Retrieval Pose Matching PDF
2022-04-20 K-LITE: Learning Transferable Visual Models with External Knowledge Sheng Shen, Chunyuan Li, Xiaowei Hu, Yujia Xie, Jianwei Yang, Pengchuan Zhang, Anna Rohrbach, Zhe Gan, Lijuan Wang, Lu Yuan, Ce Liu, Kurt Keutzer, Trevor Darrell, Jianfeng Gao arXiv_AI arXiv_AI Image_Caption Transfer_Learning Zero-Shot Knowledge Pose Classification Detection Few-Shot Object_Detection Caption Image_Classification PDF
2022-04-18 Cross-view Brain Decoding Subba Reddy Oota, Jashn Arora, Manish Gupta, Raju S. Bapi arXiv_AI arXiv_AI Image_Caption Zero-Shot Pose Action Caption PDF
2022-04-18 Optical Remote Sensing Image Understanding with Weak Supervision: Concepts, Methods, and Perspectives Jun Yue, Leyuan Fang, Pedram Ghamisi, Weiying Xie, Jun Li, Jocelyn Chanussot, Antonio J Plaza arXiv_CV arXiv_CV Image_Caption Segmentation Weakly_Supervised Face Classification Detection Object_Detection Image_Classification PDF
2022-04-16 Language-Grounded Indoor 3D Semantic Segmentation in the Wild David Rozenberszki, Or Litany, Angela Dai arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Embedding Semantic_Segmentation 3D Pose PDF
2022-04-15 It is Okay to Not Be Okay: Overcoming Emotional Bias in Affective Image Captioning by Contrastive Data Collection Youssef Mohamed, Faizan Farooq Khan, Kilichbek Haydarov, Mohamed Elhoseiny arXiv_AI arXiv_AI Image_Caption Pose Emotion Action Caption PDF
2022-04-15 Guiding Attention using Partial-Order Relationships for Image Captioning Murad Popattia, Muhammad Rafi, Rizwan Qureshi, Shah Nawaz arXiv_CV arXiv_CV Image_Caption Embedding Pose Relation Attention Caption PDF
2022-04-15 COTS: Collaborative Two-Stream Vision-Language Pre-Training Model for Cross-Modal Retrieval Haoyu Lu, Nanyi Fei, Yuqi Huo, Yizhao Gao, Zhiwu Lu, Ji-Rong Wen arXiv_CV arXiv_CV Image_Caption Transformer Pose Contrastive_Learning Face Action Attention Inference Language_Model Video_Retrieval PDF
2022-04-15 Image Captioning In the Transformer Age Yang Xu, Li Li, Haiyang Xu, Songfang Huang, Fei Huang, Jianfei Cai arXiv_CV arXiv_CV Image_Caption Transformer RNN Self-Supervised Survey Caption PDF
2022-04-15 Guided Co-Modulated GAN for 360{deg} Field of View Extrapolation Mohammad Reza Karimi Dastjerdi, Yannick Hold-Geoffroy, Jonathan Eisenmann, Siavash Khodadadeh, Jean-François Lalonde arXiv_CV arXiv_CV Image_Caption Pose Quantitative GAN PDF
2022-04-14 Masked Siamese Networks for Label-Efficient Learning Mahmoud Assran, Mathilde Caron, Ishan Misra, Piotr Bojanowski, Florian Bordes, Pascal Vincent, Armand Joulin, Michael Rabbat, Nicolas Ballas arXiv_AI arXiv_AI Image_Caption Transformer Embedding Self-Supervised Pose Classification Image_Classification PDF
2022-04-13 Hierarchical Text-Conditional Image Generation with CLIP Latents Aditya Ramesh, Prafulla Dhariwal, Alex Nichol, Casey Chu, Mark Chen arXiv_CV arXiv_CV Image_Caption Embedding Zero-Shot Pose Caption PDF
2022-04-10 TOV: The Original Vision Model for Optical Remote Sensing Image Understanding via Self-supervised Learning Chao Tao, Ji Qia, Guo Zhang, Qing Zhu, Weipeng Lu, Haifeng Li arXiv_AI arXiv_AI Image_Caption Segmentation Semantic_Segmentation Scene_Classification Optimization Knowledge Self-Supervised Pose Classification Detection Object_Detection PDF
2022-04-10 Robust Cross-Modal Representation Learning with Progressive Self-Distillation Alex Andonian, Shixing Chen, Raffay Hamid arXiv_CV arXiv_CV Image_Caption Transformer Zero-Shot Represenation_Learning Knowledge Contrastive_Learning Classification Caption PDF
2022-04-09 Joint Distribution Matters: Deep Brownian Distance Covariance for Few-Shot Classification Jiangtao Xie, Fei Long, Jiaming Lv, Qilong Wang, Peihua Li arXiv_CV arXiv_CV Image_Caption Embedding Recognition Pose Classification Few-Shot PDF
2022-04-09 Mapping Temporary Slums from Satellite Imagery using a Semi-Supervised Approach M. Fasi ur Rehman, Izza Ali, Waqas Sultani, Mohsen Ali arXiv_CV arXiv_CV Image_Caption Segmentation Embedding Semantic_Segmentation Represenation_Learning Pose Deep_Learning Detection PDF
2022-04-08 Semantic Exploration from Language Abstractions and Pretrained Representations Allison C. Tam, Neil C. Rabinowitz, Andrew K. Lampinen, Nicholas A. Roy, Stephanie C. Y. Chan, DJ Strouse, Jane X. Wang, Andrea Banino, Felix Hill arXiv_AI arXiv_AI Image_Caption Transformer Reinforcement_Learning 3D Pose Action Caption PDF
2022-04-08 Characterizing and Understanding the Behavior of Quantized Models for Reliable Deployment Qiang Hu, Yuejun Guo, Maxime Cordy, Xiaofei Xie, Wei Ma, Mike Papadakis, Yves Le Traon arXiv_AI arXiv_AI Image_Caption Quantization RNN Adversarial Pose Attention Language_Model PDF
2022-04-08 On Distinctive Image Captioning via Comparing and Reweighting Jiuniu Wang, Wenjia Xu, Qingzhong Wang, Antoni B. Chan arXiv_AI arXiv_AI Image_Caption Pose Caption PDF
2022-04-07 ECCV Caption: Correcting False Negatives by Collecting Machine-and-Human-verified Image-Caption Associations for MS-COCO Sanghyuk Chun, Wonjae Kim, Song Park, Minsuk Chang, Seong Joon Oh arXiv_CV arXiv_CV Image_Caption Pose Caption Matching PDF
2022-04-07 Adversarial Machine Learning Attacks Against Video Anomaly Detection Systems Furkan Mumcu, Keval Doshi, Yasin Yilmaz arXiv_AI arXiv_AI Image_Caption Surveillance Video_Caption Adversarial Detection PDF
2022-04-06 An Empirical Study of Remote Sensing Pretraining Di Wang, Jing Zhang, Bo Du, Gui-Song Xia, Dacheng Tao arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Semantic_Segmentation Recognition Deep_Learning Detection Object_Detection CNN PDF
2022-04-05 Hospital-Agnostic Image Representation Learning in Digital Pathology Milad Sikaroudi, Shahryar Rahnamayan, H.R. Tizhoosh arXiv_CV arXiv_CV Image_Caption Represenation_Learning Pose Classification PDF
2022-04-05 High-Quality Pluralistic Image Completion via Code Shared VQGAN Chuanxia Zheng, Guoxian Song, Tat-Jen Cham, Jianfei Cai, Dinh Phung, Linjie Luo arXiv_CV arXiv_CV Image_Caption Transformer Reconstruction Quantitative GAN Inference PDF
2022-04-04 Attribute Prototype Network for Any-Shot Learning Wenjia Xu, Yongqin Xian, Jiuniu Wang, Bernt Schiele, Zeynep Akata arXiv_CV arXiv_CV Image_Caption Embedding Zero-Shot Represenation_Learning Knowledge Pose Quantitative Classification Few-Shot Image_Classification PDF
2022-04-02 Do learned representations respect causal relationships? Lan Wang, Vishnu Naresh Boddeti arXiv_CV arXiv_CV Image_Caption 3D Represenation_Learning Pose Face Relation PDF
2022-04-01 Learning Audio-Video Modalities from Image Captions Arsha Nagrani, Paul Hongsuck Seo, Bryan Seybold, Anja Hauth, Santiago Manen, Chen Sun, Cordelia Schmid arXiv_CV arXiv_CV Image_Caption Video_Caption Pose Caption Video_Retrieval Matching PDF
2022-04-01 Socratic Models: Composing Zero-Shot Multimodal Reasoning with Language Andy Zeng, Adrian Wong, Stefan Welker, Krzysztof Choromanski, Federico Tombari, Aveek Purohit, Michael Ryoo, Vikas Sindhwani, Johnny Lee, Vincent Vanhoucke, Pete Florence arXiv_AI arXiv_AI Image_Caption OCR Zero-Shot Knowledge Pose Caption Language_Model PDF
2022-04-01 Stereo Unstructured Magnification: Multiple Homography Image for View Synthesis Qi Zhang, Xin Huang, Ying Feng, Xue Wang, Hongdong Li, Qing Wang arXiv_CV arXiv_CV Image_Caption Reconstruction Pose Quantitative PDF
2022-03-31 Misogynistic Meme Detection using Early Fusion Model with Graph Network Harshvardhan Srivastava arXiv_CL arXiv_CL Image_Caption Transformer Pose Detection Language_Model Prediction PDF
2022-03-30 Image-to-Lidar Self-Supervised Distillation for Autonomous Driving Data Corentin Sautier, Gilles Puy, Spyros Gidaris, Alexandre Boulch, Andrei Bursuc, Renaud Marlet arXiv_CV arXiv_CV Image_Caption Transformer Segmentation Semantic_Segmentation Point_Cloud 3D Sparse Self-Supervised Pose Detection Object_Detection Autonomous Matching PDF
2022-03-29 NICGSlowDown: Evaluating the Efficiency Robustness of Neural Image Caption Generation Models Simin Chen, Zihe Song, Mirazul Haque, Cong Liu, Wei Yang arXiv_AI arXiv_AI Image_Caption Pose Face Attention Caption PDF
2022-03-29 Quantifying Societal Bias Amplification in Image Captioning Yusuke Hirota, Yuta Nakashima, Noa Garcia arXiv_CV arXiv_CV Image_Caption Pose Caption Prediction PDF
2022-03-29 Self-Supervised Image Representation Learning with Geometric Set Consistency Nenglun Chen, Lei Chu, Hao Pan, Yan Lu, Wenping Wang arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation 3D Represenation_Learning Self-Supervised Pose Contrastive_Learning Face Detection Object_Detection PDF
2022-03-29 End-to-End Transformer Based Model for Image Captioning Yiyu Wang, Jungang Xu, Yingfei Sun arXiv_CV arXiv_CV Image_Caption Transformer RNN Pose Action Relation GAN Caption PDF
2022-03-27 Knowledge Mining with Scene Text for Fine-Grained Recognition Hao Wang, Junchao Liao, Tianheng Cheng, Zewen Gao, Hao Liu, Bo Ren, Xiang Bai, Wenyu Liu arXiv_CV arXiv_CV Image_Caption Recognition Bert Knowledge Pose Scene_Text Action Classification Relation Activity Image_Classification PDF
2022-03-25 Spatially Multi-conditional Image Generation Ritika Chakraborty, Nikola Popovic, Danda Pani Paudel, Thomas Probst, Luc Van Gool arXiv_CV arXiv_CV Image_Caption Transformer Adversarial Pose PDF
2022-03-24 Linking Emergent and Natural Languages via Corpus Transfer Shunyu Yao, Mo Yu, Yang Zhang, Karthik R Narasimhan, Joshua B. Tenenbaum, Chuang Gan arXiv_CL arXiv_CL Image_Caption Transformer Pose Relation Caption Language_Model PDF
2022-03-23 StructToken : Rethinking Semantic Segmentation with Structural Prior Fangjian Lin, Zhanhao Liang, Junjun He, Miao Zheng, Shengwei Tian, Kai Chen arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation Pose Action Classification Deep_Learning PDF
2022-03-23 GOSS: Towards Generalized Open-set Semantic Segmentation Jie Hong, Weihao Li, Junlin Han, Jiyang Zheng, Pengfei Fang, Mehrtash Harandi, Lars Petersson arXiv_RO arXiv_RO Image_Caption Segmentation Semantic_Segmentation Pose Classification PDF
2022-03-22 WuDaoMM: A large-scale Multi-Modal Dataset for Pre-training models Sha Yuan, Zhao Shuai, Leng Jiahong, Xue Zhao, Zhao Hanyu, Tang Jie arXiv_CL arXiv_CL Image_Caption Transformer Relation VQA Caption QA PDF
2022-03-22 Self-Supervised Representation Learning as Multimodal Variational Inference Hiroki Nakamura, Masashi Okada, Tadahiro Taniguchi arXiv_CV arXiv_CV Image_Caption Represenation_Learning Self-Supervised Pose Classification Relation Inference PDF
2022-03-20 Partitioning Image Representation in Contrastive Learning Hyunsub Lee, Heeyoul Choi arXiv_AI arXiv_AI Image_Caption Contrastive_Learning Classification Few-Shot PDF
2022-03-18 Nonnegative-Constrained Joint Collaborative Representation with Union Dictionary for Hyperspectral Anomaly Detection Shizhen Chang, Pedram Ghamisi arXiv_CV arXiv_CV Image_Caption Optimization Regularization Pose Detection Object_Detection PDF
2022-03-18 AlignTransformer: Hierarchical Alignment of Visual Regions and Disease Tags for Medical Report Generation Di You, Fenglin Liu, Shen Ge, Xiaoxia Xie, Jing Zhang, Xian Wu arXiv_CV arXiv_CV Image_Caption Transformer Pose Attention Medical Caption PDF
2022-03-17 On Vision Features in Multimodal Machine Translation Bei Li, Chuanhao Lv, Zefan Zhou, Tao Zhou, Tong Xiao, Anxiang Ma, JingBo Zhu arXiv_CL arXiv_CL Image_Caption Transformer Detection Attention Caption PDF
2022-03-17 UNIMO-2: End-to-End Unified Vision-Language Grounded Learning Wei Li, Can Gao, Guocheng Niu, Xinyan Xiao, Hao Liu, Jiachen Liu, Hua Wu, Haifeng Wang arXiv_CV arXiv_CV Image_Caption Transformer Pose Caption PDF
2022-03-17 DU-VLG: Unifying Vision-and-Language Generation via Dual Sequence-to-Sequence Pre-training Luyang Huang, Guocheng Niu, Jiachen Liu, Xinyan Xiao, Hua Wu arXiv_AI arXiv_AI Image_Caption Transformer Pose Denoising Caption PDF
2022-03-14 Leveraging Visual Knowledge in Language Tasks: An Empirical Study on Intermediate Pre-training for Cross-modal Knowledge Transfer Woojeong Jin, Dong-Ho Lee, Chenguang Zhu, Jay Pujara, Xiang Ren arXiv_CL arXiv_CL Image_Caption Transformer Knowledge Caption Language_Model PDF
2022-03-14 Contrastive Visual Semantic Pretraining Magnifies the Semantics of Natural Language Representations Robert Wolfe, Aylin Caliskan arXiv_CL arXiv_CL Image_Caption Embedding Zero-Shot Caption PDF
2022-03-14 Generalized Rectifier Wavelet Covariance Models For Texture Synthesis Antoine Brochard, Sixin Zhang, Stéphane Mallat arXiv_CV arXiv_CV Image_Caption Pose CNN PDF
2022-03-14 CLIP Models are Few-shot Learners: Empirical Studies on VQA and Visual Entailment Haoyu Song, Li Dong, Wei-Nan Zhang, Ting Liu, Furu Wei arXiv_CL arXiv_CL Image_Caption Transformer Zero-Shot Pose VQA Few-Shot Caption QA PDF
2022-03-13 Depth-Aware Generative Adversarial Network for Talking Head Video Generation Fa-Ting Hong, Longhao Zhang, Li Shen, Dan Xu arXiv_CV arXiv_CV Image_Caption 3D Sparse Adversarial Self-Supervised Pose Face Attention GAN PDF
2022-03-12 Chart-to-Text: A Large-Scale Benchmark for Chart Summarization Shankar Kanthara, Rixie Tiffany Ko Leong, Xiang Lin, Ahmed Masry, Megh Thakkar, Enamul Hoque, Shafiq Joty arXiv_CL arXiv_CL Image_Caption Summarization Text_Generation Caption PDF
2022-03-12 Enabling Multimodal Generation on CLIP via Vision-Language Knowledge Distillation Wenliang Dai, Lu Hou, Lifeng Shang, Xin Jiang, Qun Liu, Pascale Fung arXiv_AI arXiv_AI Image_Caption Transformer Zero-Shot Knowledge Pose VQA Caption Language_Model QA PDF
2022-03-11 Perception Over Time: Temporal Dynamics for Robust Image Understanding Maryam Daniali, Edward Kim arXiv_CV arXiv_CV Image_Caption Adversarial Pose Quantitative Classification Deep_Learning PDF
2022-03-10 Two-stream Hierarchical Similarity Reasoning for Image-text Matching Ran Chen, Hanli Wang, Lei Wang, Sam Kwong arXiv_CV arXiv_CV Image_Caption Pose Action Matching PDF
2022-03-09 NLX-GPT: A Model for Natural Language Explanations in Vision and Vision-Language Tasks Fawaz Sammani, Tanmoy Mukherjee, Nikos Deligiannis arXiv_CV arXiv_CV Image_Caption Transformer VQA Caption Inference Language_Model Prediction QA PDF
2022-03-09 Efficient Image Representation Learning with Federated Sampled Softmax Sagar M. Waghmare, Hang Qi, Huizhong Chen, Mikhail Sirotenko, Tomer Meron arXiv_CV arXiv_CV Image_Caption Represenation_Learning PDF
2022-03-08 Semantic Distillation Guided Salient Object Detection Bo Xu, Guanze Liu, Han Huang, Cheng Lu, Yandong Guo arXiv_CL arXiv_CL Image_Caption Transformer Segmentation Salient Knowledge Pose Detection Object_Detection Caption PDF
2022-03-08 Mutual Contrastive Learning to Disentangle Whole Slide Image Representations for Glioma Grading Lipei Zhang, Yiran Wei, Ying Fu, Stephen Price, Carola-Bibiane Schönlieb, Chao Li arXiv_CV arXiv_CV Image_Caption Pose Contrastive_Learning PDF
2022-03-07 OverlapTransformer: An Efficient and Rotation-Invariant Transformer Network for LiDAR-Based Place Recognition Junyi Ma, Jun Zhang, Jintao Xu, Rui Ai, Weihao Gu, Cyrill Stachniss, Xieyuanli Chen arXiv_RO arXiv_RO Image_Caption Transformer Recognition 3D Pose SLAM Autonomous PDF
2022-03-07 Least Square Estimation Network for Depth Completion Xianze Fang, Zexi Chen, Yunkai Wang, Yue Wang, Rong Xiong arXiv_RO arXiv_RO Image_Caption Sparse Pose PDF
2022-03-07 Dynamic MLP for Fine-Grained Image Classification by Leveraging Geographical and Temporal Information Lingfeng Yang, Xiang Li, Renjie Song, Borui Zhao, Juntian Tao, Shihao Zhou, Jiajun Liang, Jian Yang arXiv_CV arXiv_CV Image_Caption Embedding Knowledge Pose Classification Image_Classification PDF
2022-03-07 Unpaired Image Captioning by Image-level Weakly-Supervised Visual Concept Recognition Peipei Zhu, Xiao Wang, Yong Luo, Zhenglong Sun, Wei-Shi Zheng, Yaowei Wang, Changwen Chen arXiv_CV arXiv_CV Image_Caption Recognition Optimization Knowledge Pose Relation Caption PDF
2022-03-04 DiT: Self-supervised Pre-training for Document Image Transformer Junlong Li, Yiheng Xu, Tengchao Lv, Lei Cui, Cha Zhang, Furu Wei arXiv_CV arXiv_CV Image_Caption Transformer Self-Supervised Pose Classification Detection Image_Classification PDF
2022-03-04 FS-COCO: Towards Understanding of Freehand Sketches of Common Objects in Context Pinaki Nath Chowdhury, Aneeshan Sain, Yulia Gryaditskaya, Ayan Kumar Bhunia, Tao Xiang, Yi-Zhe Song arXiv_CV arXiv_CV Image_Caption Sketch RNN Image_Retrieval Pose Action Caption PDF
2022-03-03 Fast Neural Architecture Search for Lightweight Dense Prediction Networks Lam Huynh, Esa Rahtu, Jiri Matas, Janne Heikkila arXiv_CV arXiv_CV Image_Caption Surveillance NAS Segmentation Semantic_Segmentation Super_Resolution Classification Medical Prediction PDF
2022-03-03 A Deep Neural Framework for Image Caption Generation Using GRU-Based Attention Mechanism Rashid Khan, M Shujah Islam, Khadija Kanwal, Mansoor Iqbal, Md. Imran Hossain, Zhongfu Ye arXiv_CV arXiv_CV Image_Caption RNN Attention Caption CNN Language_Model PDF
2022-03-02 A Principled Design of Image Representation: Towards Forensic Tasks Shuren Qi, Yushu Zhang, Chao Wang, Jiantao Zhou, Xiaochun Cao arXiv_CV arXiv_CV Image_Caption Pose Action Detection Matching PDF
2022-02-28 Interactive Machine Learning for Image Captioning Mareike Hartmann, Aliki Anagnostopoulou, Daniel Sonntag arXiv_CV arXiv_CV Image_Caption Review Pose Caption PDF
2022-02-27 Meta-RangeSeg: LiDAR Sequence Semantic Segmentation Using Multiple Feature Aggregation Song Wang, Jianke Zhu, Ruixiang Zhang arXiv_CV arXiv_CV Image_Caption Segmentation Semantic_Segmentation Point_Cloud 3D Pose CNN Autonomous PDF
2022-02-24 New Benchmark for Household Garbage Image Recognition Zhize Wu, Huanyi Li, Xiaofeng Wang, Zijun Wu, Le Zou, Lixiang Xu, Ming Tan arXiv_CV arXiv_CV Image_Caption Recognition Represenation_Learning Face Classification Deep_Learning CNN Image_Classification PDF
2022-02-21 CaMEL: Mean Teacher Learning for Image Captioning Manuele Barraco, Matteo Stefanini, Marcella Cornia, Silvia Cascianelli, Lorenzo Baraldi, Rita Cucchiara arXiv_CV arXiv_CV Image_Caption Transformer Knowledge Pose Action Caption Language_Model PDF
2022-02-18 A Survey of Vision-Language Pre-Trained Models Yifan Du, Zikang Liu, Junyi Li, Wayne Xin Zhao arXiv_CV arXiv_CV Image_Caption Transformer Embedding Review Survey Action PDF
2022-02-18 AMS_ADRN at SemEval-2022 Task 5: A Suitable Image-text Multimodal Joint Modeling Method for Multi-task Misogyny Identification Da Li, Ming Yi, Yukai He arXiv_CL arXiv_CL Image_Caption Transformer Embedding Bert PDF
2022-02-16 Edge Data Based Trailer Inception Probabilistic Matrix Factorization for Context-Aware Movie Recommendation Honglong Chen, Zhe Li, Zhu Wang, Zhichen Ni, Junjian Li, Ge Xu, Abdul Aziz, Feng Xia arXiv_CV arXiv_CV Image_Caption Sparse Pose Action Caption CNN Prediction Recommendation PDF
2022-02-14 Do Lessons from Metric Learning Generalize to Image-Caption Retrieval? Maurits Bleeker, Maarten de Rijke arXiv_AI arXiv_AI Image_Caption Optimization Represenation_Learning Image_Retrieval Caption PDF
2022-02-14 I-Tuning: Tuning Language Models with Image for Caption Generation Ziyang Luo, Yadong Xi, Rongsheng Zhang, Jing Ma arXiv_CV arXiv_CV Image_Caption Transformer Pose Caption Language_Model PDF
2022-02-11 A Wasserstein GAN for Joint Learning of Inpainting and its Spatial Optimisation Pascal Peter arXiv_CV arXiv_CV Image_Caption Inpainting Restoration Sparse Adversarial Pose GAN PDF
2022-02-11 Bench-Marking And Improving Arabic Automatic Image Captioning Through The Use Of Multi-Task Learning Paradigm Muhy Eddin Za'ter, Bashar Talaftha arXiv_CV arXiv_CV Image_Caption Embedding Caption PDF
2022-02-11 ACORT: A Compact Object Relation Transformer for Parameter Efficient Image Captioning Jia Huei Tan, Ying Hua Tan, Chee Seng Chan, Joon Huang Chuah arXiv_CV arXiv_CV Image_Caption Transformer Pose Relation Attention Caption PDF
2022-02-10 Describing image focused in cognitive and visual details for visually impaired people: An approach to generating inclusive paragraphs Daniel Louzada Fernandes, Marcos Henrique Fonseca Ribeiro, Fabio Ribeiro Cerqueira, Michel Melo Silva arXiv_CV arXiv_CV Image_Caption Pose Caption Language_Model PDF
2022-02-08 DALL-Eval: Probing the Reasoning Skills and Social Biases of Text-to-Image Generative Transformers Jaemin Cho, Abhay Zala, Mohit Bansal arXiv_CV arXiv_CV Image_Caption Transformer Image_Generation Recognition Pose Classification Relation Attention Caption Image_Classification Language_Model PDF
2022-02-08 Wireless Transmission of Images With The Assistance of Multi-level Semantic Information Zhenguo Zhang, Qianqian Yang, Shibo He, Mingyang Sun, Jiming Chen arXiv_CV arXiv_CV Image_Caption Segmentation Pose Deep_Learning Caption PDF
2022-02-08 Self-supervised Contrastive Learning for Cross-domain Hyperspectral Image Representation Hyungtae Lee, Heesung Kwon arXiv_CV arXiv_CV Image_Caption Transfer_Learning Self-Supervised Pose Contrastive_Learning Classification Attention PDF
2022-02-07 Motion-Plane-Adaptive Inter Prediction in 360-Degree Video Coding Andy Regensky, Christian Herglotz, André Kaup arXiv_CV arXiv_CV Image_Caption 3D Pose Prediction PDF
2022-02-07 Unifying Architectures, Tasks, and Modalities Through a Simple Sequence-to-Sequence Learning Framework Peng Wang, An Yang, Rui Men, Junyang Lin, Shuai Bai, Zhikang Li, Jianxin Ma, Chang Zhou, Jingren Zhou, Hongxia Yang arXiv_CV arXiv_CV Image_Caption Bert Pose Classification VQA Text_Generation Caption Image_Classification QA PDF
2022-02-01 HCSC: Hierarchical Contrastive Selective Coding Yuanfan Guo, Minghao Xu, Jiawen Li, Bingbing Ni, Xuanyu Zhu, Zhenbang Sun, Yi Xu arXiv_CV arXiv_CV Image_Caption Represenation_Learning Pose Contrastive_Learning PDF
2022-01-31 Deep Learning Approaches on Image Captioning: A Review Taraneh Ghandi, Hamidreza Pourreza, Hamidreza Mahyar arXiv_CV arXiv_CV Image_Caption Review Survey Deep_Learning Caption PDF
2022-01-30 VC-GPT: Visual Conditioned GPT for End-to-End Generative Vision-and-Language Pre-training Ziyang Luo, Yadong Xi, Rongsheng Zhang, Jing Ma arXiv_CV arXiv_CV Image_Caption Transformer Pose Attention Caption PDF
2022-01-28 BLIP: Bootstrapping Language-Image Pre-training for Unified Vision-Language Understanding and Generation Junnan Li, Dongxu Li, Caiming Xiong, Steven Hoi arXiv_CV arXiv_CV Image_Caption Transformer Zero-Shot Pose VQA Caption QA PDF
2022-01-26 Evaluating language-biased image classification based on semantic representations Yoann Lemesle, Masataka Sawayama, Guillermo Valle-Perez, Maxime Adolphe, Hélène Sauzéon, Pierre-Yves Oudeyer arXiv_CV arXiv_CV Image_Caption Recognition Pose Classification Relation Image_Classification PDF
2022-01-25 Projective Urban Texturing Yiangos Georgiou, Melinos Averkiou, Tom Kelly, Evangelos Kalogerakis arXiv_CV arXiv_CV Image_Caption 3D Adversarial Pose Quantitative PDF
2022-01-23 Average Biased ReLU Based CNN Descriptor for Improved Face Retrieval Shiv Ram Dubey, Soumendu Chakraborty arXiv_CV arXiv_CV Image_Caption Pose Face CNN PDF
2022-01-23 An Integrated Approach for Video Captioning and Applications Soheyla Amirian, Thiab R. Taha, Khaled Rasheed, Hamid R. Arabnia arXiv_AI arXiv_AI Image_Caption Video_Caption Deep_Learning Caption PDF
2022-01-22 Visual Information Guided Zero-Shot Paraphrase Generation Zhe Lin, Xiaojun Wan arXiv_AI arXiv_AI Image_Caption Zero-Shot Pose Attention Caption PDF
2022-01-21 A System for Image Understanding using Sensemaking and Narrative Zev Battad, Mei Si arXiv_AI arXiv_AI Image_Caption Knowledge Inference PDF
2022-01-20 CELESTIAL: Classification Enabled via Labelless Embeddings with Self-supervised Telescope Image Analysis Learning Suhas Kotha, Anirudh Koul, Siddha Ganju, Meher Kasam arXiv_CV arXiv_CV Image_Caption Embedding Unsupervised Scene_Classification Sparse Image_Retrieval Knowledge Self-Supervised Classification PDF
2022-01-17 A Novel Framework to Jointly Compress and Index Remote Sensing Images for Efficient Content-Based Retrieval Jun Xiang, Gencer Sumbul, Nimisha Thekke Madam, Begüm Demir arXiv_CV arXiv_CV Image_Caption Image_Retrieval Pose Classification Image_Compression PDF
2022-01-16 PETS-SWINF: A regression method that considers images with metadata based Neural Network for pawpularity prediction on 2021 Kaggle Competition 'PetFinder.my' Yizheng Wang, Yinghua Liu arXiv_AI arXiv_AI Image_Caption Pose Prediction PDF
2022-01-14 Multimodal registration of FISH and nanoSIMS images using convolutional neural network models Xiaojia He, Christof Meile, Suchendra M. Bhandarkar arXiv_CV arXiv_CV Image_Caption Action Activity CNN Matching PDF
2022-01-14 A Thousand Words Are Worth More Than a Picture: Natural Language-Centric Outside-Knowledge Visual Question Answering Feng Gao, Qing Ping, Govind Thattai, Aishwarya Reganti, Ying Nian Wu, Prem Natarajan arXiv_CV arXiv_CV Image_Caption Knowledge Pose VQA GAN Language_Model QA PDF
2022-01-11 Uni-EDEN: Universal Encoder-Decoder Network by Multi-Granular Vision-Language Pre-training Yehao Li, Jiahao Fan, Yingwei Pan, Ting Yao, Weiyao Lin, Tao Mei arXiv_CV arXiv_CV Image_Caption Transformer Knowledge Action Classification VQA Caption Language_Model Matching PDF
2022-01-10 Cross-Modality Sub-Image Retrieval using Contrastive Multimodal Image Representations Eva Breznik, Elisabeth Wetzer, Joakim Lindblad, Nataša Sladoje arXiv_CV arXiv_CV Image_Caption Image_Retrieval Adversarial Pose Deep_Learning GAN PDF
2022-01-07 Repurposing Existing Deep Networks for Caption and Aesthetic-Guided Image Cropping Nora Horanyi, Kedi Xia, Kwang Moo Yi, Abhishake Kumar Bojja, Ales Leonardis, Hyung Jin Chang arXiv_CV arXiv_CV Image_Caption Optimization Pose Action Quantitative Caption PDF
2022-01-06 A wearable sensor vest for social humanoid robots with GPGPU, IoT, and modular software architecture Mohsen Jafarzadeh, Stephen Brooks, Shimeng Yu, Balakrishnan Prabhakaran, Yonas Tadesse arXiv_AI arXiv_AI Image_Caption Gesture Speech Pose Face Action PDF
2022-01-06 TransVPR: Transformer-based place recognition with multi-level attention aggregation Ruotong Wang, Yanqing Shen, Weiliang Zuo, Sanping Zhou, Nanning Zhen arXiv_CV arXiv_CV Image_Caption Transformer Recognition Attention Autonomous Matching PDF
2022-01-06 Compact Bidirectional Transformer for Image Captioning Yuanen Zhou, Zhenzhen Hu, Daqing Liu, Huixia Ben, Meng Wang arXiv_CV arXiv_CV Image_Caption Transformer Regularization Action Caption PDF
2022-01-05 Synthesizing Tensor Transformations for Visual Self-attention Xian Wei, Xihao Wang, Hai Lan, JiaMing Lei, Yanhui Huang, Hui Yu, Jian Yang arXiv_CV arXiv_CV Image_Caption Pose Classification Relation Attention Caption Image_Classification PDF
2022-01-04 Sound and Visual Representation Learning with Multiple Pretraining Tasks Arun Balajee Vasudevan, Dengxin Dai, Luc Van Gool arXiv_CV arXiv_CV Image_Caption Super_Resolution Represenation_Learning Self-Supervised Pose Classification Detection Prediction Video_Retrieval PDF
2022-01-04 StyleM: Stylized Metrics for Image Captioning Built with Contrastive N-grams Chengxi Li, Brent Harrison arXiv_AI arXiv_AI Image_Caption Caption PDF
2022-01-04 Interactive Attention AI to translate low light photos to captions for night scene understanding in women safety Rajagopal A, Nirmala V, Arun Muthuraj Vedamanickam arXiv_CV arXiv_CV Image_Caption Transformer Enhancement Image_Enhancement Deep_Learning VQA Attention Caption Language_Model PDF
2021-12-31 ERNIE-ViLG: Unified Generative Pre-training for Bidirectional Vision-Language Generation Han Zhang, Weichong Yin, Yewei Fang, Lanxin Li, Boqiang Duan, Zhihua Wu, Yu Sun, Hao Tian, Hua Wu, Haifeng Wang arXiv_CV arXiv_CV Image_Caption Transformer Quantization Pose Text_Generation Caption PDF
2021-12-30 Continually Learning Self-Supervised Representations with Projected Functional Regularization Alex Gomez-Villa, Bartlomiej Twardowski, Lu Yu, Andrew D. Bagdanov, Joost van de Weijer arXiv_CV arXiv_CV Image_Caption Transformer Regularization Knowledge Self-Supervised Pose PDF
2021-12-30 Knowledge Matters: Radiology Report Generation with General and Specific Knowledge Shuxin Yang, Xian Wu, Shen Ge, Shaohua Kevin Zhou, Li Xiao arXiv_CV arXiv_CV Image_Caption Knowledge Pose Attention Medical Caption PDF
2021-12-28 Extended Self-Critical Pipeline for Transforming Videos to Text -- Team: MMCUniAugsburg Philipp Harzig, Moritz Einfalt, Katja Ludwig, Rainer Lienhart arXiv_CV arXiv_CV Image_Caption Transformer Attention Caption PDF
2021-12-28 Synchronized Audio-Visual Frames with Fractional Positional Encoding for Transformers in Video-to-Text Translation Philipp Harzig, Moritz Einfalt, Rainer Lienhart arXiv_CV arXiv_CV Image_Caption Transformer Action Caption PDF
2021-12-27 A Fistful of Words: Learning Transferable Visual Models from Bag-of-Words Supervision Ajinkya Tejankar, Ajinkya Tejankar, Bichen Wu, Saining Xie, Madian Khabsa, Hamed Pirsiavash, Hamed Firooz arXiv_CV arXiv_CV Image_Caption Recognition Zero-Shot Classification Caption Image_Classification PDF
2021-12-20 MuMuQA: Multimedia Multi-Hop News Question Answering via Cross-Media Knowledge Extraction and Grounding Revanth Gangi Reddy, Xilin Rui, Manling Li, Xudong Lin, Haoyang Wen, Jaemin Cho, Lifu Huang, Mohit Bansal, Avirup Sil, Shih-Fu Chang, Alexander Schwing, Heng Ji arXiv_CV arXiv_CV Image_Caption Knowledge Action Caption QA PDF
2021-12-16 Distilled Dual-Encoder Model for Vision-Language Understanding Zekun Wang, Wenhui Wang, Haichao Zhu, Ming Liu, Bing Qin, Furu Wei arXiv_CV arXiv_CV Image_Caption Transformer Pose Action VQA Attention Inference PDF
2021-12-14 Stochastic Actor-Executor-Critic for Image-to-Image Translation Ziwei Luo, Jing Hu, Xin Wang, Siwei Lyu, Bin Kong, Youbing Yin, Qi Song, Xi Wu arXiv_CV arXiv_CV Image_Caption Reinforcement_Learning Pose Action PDF
2021-12-14 ACE-BERT: Adversarial Cross-modal Enhanced BERT for E-commerce Retrieval Boxuan Zhang, Chao Wei, Yan Jin, Weiru Zhang arXiv_AI arXiv_AI Image_Caption Transformer Bert Adversarial Pose PDF
2021-12-13 VL-Adapter: Parameter-Efficient Transfer Learning for Vision-and-Language Tasks Yi-Lin Sung, Jaemin Cho, Mohit Bansal arXiv_AI arXiv_AI Image_Caption Transfer_Learning Knowledge Pose VQA Caption Language_Model QA PDF
2021-12-13 MAGIC: Multimodal relAtional Graph adversarIal inferenCe for Diverse and Unpaired Text-based Image Captioning Wenqiao Zhang, Haochen Shi, Jiannan Guo, Shengyu Zhang, Qingpeng Cai, Juncheng Li, Sihui Luo, Yueting Zhuang arXiv_AI arXiv_AI Image_Caption Adversarial Pose Relation Caption Inference PDF
2021-12-13 SphereSR Youngho Yoon, Inchul Chung, Lin Wang, Kuk-Jin Yoon arXiv_CV arXiv_CV Image_Caption Super_Resolution Pose Face Action Attention PDF
2021-12-10 Enhancing Multi-Scale Implicit Learning in Image Super-Resolution with Integrated Positional Encoding Ying-Tian Liu, Yuan-Chen Guo, Song-Hai Zhang arXiv_CV arXiv_CV Image_Caption Super_Resolution Pose Quantitative PDF
2021-12-09 Injecting Semantic Concepts into End-to-End Image Captioning Zhiyuan Fang, Jianfeng Wang, Xiaowei Hu, Lin Liang, Zhe Gan, Lijuan Wang, Yezhou Yang, Zicheng Liu arXiv_CV arXiv_CV Image_Caption Transformer Pose Classification Detection Object_Detection Caption Inference PDF
2021-12-09 Self-Supervised Image-to-Text and Text-to-Image Synthesis Anindya Sundar Das, Sriparna Saha arXiv_CV arXiv_CV Image_Caption Embedding RNN Self-Supervised Pose Quantitative Deep_Learning Relation GAN Text_Generation PDF
2021-12-08 Bidimensional Leaderboards: Generate and Evaluate Language Hand in Hand Jungo Kasai, Keisuke Sakaguchi, Ronan Le Bras, Lavinia Dunagan, Jacob Morrison, Alexander R. Fabbri, Yejin Choi, Noah A. Smith arXiv_CL arXiv_CL Image_Caption Pose Relation Summarization Caption PDF
2021-12-07 Parallel Discrete Convolutions on Adaptive Particle Representations of Images Joel Jonsson, Bevan L. Cheeseman, Suryanarayana Maddu, Krzysztof Gonciarz, Ivo F. Sbalzarini arXiv_CV arXiv_CV Image_Caption Sparse PDF
2021-12-06 Embedding Arithmetic for Text-driven Image Transformation Guillaume Couairon, Matthieu Cord, Matthijs Douze, Holger Schwenk arXiv_CV arXiv_CV Image_Caption Embedding Relation Matching PDF
2021-12-06 Real-time Registration and Reconstruction with Cylindrical LiDAR Images Wei Dong, Kwonyoung Ryu, Michael Kaess, Jaesik Park arXiv_CV arXiv_CV Image_Caption Reconstruction Point_Cloud 3D Pose PDF
2021-12-05 Protecting Intellectual Property of Language Generation APIs with Lexical Watermark Xuanli He, Qiongkai Xu, Lingjuan Lyu, Fangzhao Wu, Chenguang Wang arXiv_CL arXiv_CL Image_Caption Pose Action Summarization Text_Generation Caption PDF
2021-12-02 Learning the semantic structure of objects from Web supervision David Novotny, Diane Larlus, Andrea Vedaldi arXiv_CV arXiv_CV Image_Caption Embedding Pose Relation PDF
2021-12-02 Consensus Graph Representation Learning for Better Grounded Image Captioning Wenqiao Zhang, Haochen Shi, Siliang Tang, Jun Xiao, Qiang Yu, Yueting Zhuang arXiv_AI arXiv_AI Image_Caption Represenation_Learning Pose Classification Caption PDF
2021-12-02 Object-Centric Unsupervised Image Captioning Zihang Meng, David Yang, Xuefei Cao, Ashish Shah, Ser-Nam Lim arXiv_AI arXiv_AI Image_Caption Transformer Unsupervised Relation Caption PDF
2021-12-01 On-Device Spatial Attention based Sequence Learning Approach for Scene Text Script Identification Rutika Moharir, Arun D Prabhu, Sukumar Moharana, Gopi Ramena, Rachit S Munjal arXiv_CV arXiv_CV Image_Caption OCR RNN Scene_Text Classification Attention CNN Inference PDF
2021-12-01 Translation-equivariant Image Quantizer for Bi-directional Image-Text Generation Woncheol Shin, Gyubok Lee, Jiyoung Lee, Joonseok Lee, Edward Choi arXiv_CV arXiv_CV Image_Caption Embedding Pose GAN Text_Generation PDF
2021-11-30 Open-Domain, Content-based, Multi-modal Fact-checking of Out-of-Context Images via Online Resources Sahar Abdelnabi, Rakibul Hasan, Mario Fritz arXiv_CV arXiv_CV Image_Caption OCR Pose Caption PDF
2021-11-29 Neural Attention for Image Captioning: Review of Outstanding Methods Zanyar Zohourianshahzadi, Jugal K. Kalita arXiv_CV arXiv_CV Image_Caption Review Survey Deep_Learning Attention Caption PDF
2021-11-29 Zero-Shot Image-to-Text Generation for Visual-Semantic Arithmetic Yoad Tewel, Yoav Shalev, Idan Schwartz, Lior Wolf arXiv_AI arXiv_AI Image_Caption Zero-Shot Knowledge Pose Contrastive_Learning Text_Generation Caption Inference Language_Model Matching PDF
2021-11-28 Learning To Segment Dominant Object Motion From Watching Videos Sahir Shrestha, Mohammad Ali Armin, Hongdong Li, Nick Barnes arXiv_CV arXiv_CV Image_Caption Segmentation Unsupervised Salient Deep_Learning Optical_Flow Inference PDF
2021-11-25 Scene Graph Generation with Geometric Context Vishal Kumar, Albert Mundu, Satish Kumar Singh arXiv_AI arXiv_AI Image_Caption Recognition Knowledge Relation VQA Attention Caption Activity PDF
2021-11-24 Universal Captioner: Long-Tail Vision-and-Language Model Training through Content-Style Separation Marcella Cornia, Lorenzo Baraldi, Giuseppe Fiameni, Rita Cucchiara arXiv_AI arXiv_AI Image_Caption Zero-Shot Pose Caption Language_Model PDF
2021-11-24 Utilizing Resource-Rich Language Datasets for End-to-End Scene Text Recognition in Resource-Poor Languages Shota Orihashi, Yoshihiro Yamazaki, Naoki Makishima, Mana Ihori, Akihiko Takashima, Tomohiro Tanaka, Ryo Masumura arXiv_CV arXiv_CV Image_Caption Transformer Recognition Knowledge Pose Scene_Text PDF
2021-11-24 Scaling Up Vision-Language Pre-training for Image Captioning Xiaowei Hu, Zhe Gan, Jianfeng Wang, Zhengyuan Yang, Zicheng Liu, Yumao Lu, Lijuan Wang arXiv_CV arXiv_CV Image_Caption Transformer Zero-Shot Caption PDF
2021-11-23 Crossing the Format Boundary of Text and Boxes: Towards Unified Vision-Language Modeling Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Faisal Ahmed, Zicheng Liu, Yumao Lu, Lijuan Wang arXiv_CV arXiv_CV Image_Caption Transformer Pose VQA Text_Generation Caption Language_Model Prediction PDF
2021-11-22 Florence: A New Foundation Model for Computer Vision Lu Yuan, Dongdong Chen, Yi-Ling Chen, Noel Codella, Xiyang Dai, Jianfeng Gao, Houdong Hu, Xuedong Huang, Boxin Li, Chunyuan Li, Ce Liu, Mengchen Liu, Zicheng Liu, Yumao Lu, Yu Shi, Lijuan Wang, Jianfeng Wang, Bin Xiao, Zhen Xiao, Jianwei Yang, Michael Zeng, Luowei Zhou, Pengchuan Zhang arXiv_AI arXiv_AI Image_Caption Transfer_Learning Recognition Zero-Shot Pose Action_Recognition Action Classification Detection VQA Few-Shot Object_Detection Caption QA Video_Retrieval PDF
2021-11-22 L-Verse: Bidirectional Generation Between Image and Text Taehoon Kim, Gwangmo Song, Sihaeng Lee, Sangyun Kim, Yewon Seo, Soonyoung Lee, Seung Hwan Kim, Honglak Lee, Kyunghoon Bae arXiv_CV arXiv_CV Image_Caption Transformer Reconstruction Represenation_Learning Pose Action Quantitative Detection Relation Object_Detection Text_Generation Caption PDF
2021-11-20 Are Vision Transformers Robust to Patch Perturbations? Jindong Gu, Volker Tresp, Yao Qin arXiv_CV arXiv_CV Image_Caption Transformer Adversarial Quantitative Classification Attention CNN Image_Classification PDF
2021-11-19 UFO: A UniFied TransfOrmer for Vision-Language Representation Learning Jianfeng Wang, Xiaowei Hu, Zhe Gan, Zhengyuan Yang, Xiyang Dai, Zicheng Liu, Yumao Lu, Lijuan Wang arXiv_CV arXiv_CV Image_Caption Transformer Optimization Represenation_Learning Pose VQA Attention Caption Language_Model Matching PDF
2021-11-18 ClipCap: CLIP Prefix for Image Captioning Ron Mokady, Amir Hertz, Amit H. Bermano arXiv_CV arXiv_CV Image_Caption Pose Quantitative Caption Language_Model PDF
2021-11-17 Transparent Human Evaluation for Image Captioning Jungo Kasai, Keisuke Sakaguchi, Lavinia Dunagan, Jacob Morrison, Ronan Le Bras, Yejin Choi, Noah A. Smith arXiv_CV arXiv_CV Image_Caption Salient Caption PDF
2021-11-11 Unsupervised Part Discovery from Contrastive Reconstruction Subhabrata Choudhury, Iro Laina, Christian Rupprecht, Andrea Vedaldi arXiv_CV arXiv_CV Image_Caption Reconstruction Segmentation Unsupervised Represenation_Learning Self-Supervised Pose Classification Attention PDF
2021-11-10 Automated Pulmonary Embolism Detection from CTPA Images Using an End-to-End Convolutional Neural Network Yi Lin, Jianchao Su, Xiang Wang, Xiang Li, Jingen Liu, Kwang-Ting Cheng, Xin Yang arXiv_CV arXiv_CV Image_Caption 3D Pose Classification Detection CNN PDF
2021-11-07 Machine-in-the-Loop Rewriting for Creative Image Captioning Vishakh Padmakumar, He He arXiv_CL arXiv_CL Image_Caption Caption Language_Model PDF
2021-11-05 The Curious Layperson: Fine-Grained Image Recognition without Expert Labels Subhabrata Choudhury, Iro Laina, Christian Rupprecht, Andrea Vedaldi arXiv_CV arXiv_CV Image_Caption Recognition Knowledge PDF
2021-11-04 Generalized Radiograph Representation Learning via Cross-supervision between Images and Free-text Radiology Reports Hong-Yu Zhou, Xiaoyu Chen, Yinghao Zhang, Ruibang Luo, Liansheng Wang, Yizhou Yu arXiv_CV arXiv_CV Image_Caption Transformer Transfer_Learning Represenation_Learning Review Self-Supervised Pose Deep_Learning PDF
2021-10-26 Directional Self-supervised Learning for Risky Image Augmentations Yalong Bai, Yifan Yang, Wei Zhang, Tao Mei arXiv_CV arXiv_CV Image_Caption Represenation_Learning Self-Supervised Pose Relation PDF
2021-10-24 Bangla Image Caption Generation through CNN-Transformer based Encoder-Decoder Network Md Aminul Haque Palash, MD Abdullah Al Nasim, Sourav Saha, Faria Afrin, Raisa Mallik, Sathishkumar Samiappan arXiv_CV arXiv_CV Image_Caption Transformer Pose Action Attention Caption PDF
2021-10-22 Exploiting Cross-Modal Prediction and Relation Consistency for Semi-Supervised Image Captioning Yang Yang, Hongchen Wei, Hengshu Zhu, Dianhai Yu, Hui Xiong, Qingshan Liu, Jian Yang arXiv_AI arXiv_AI Image_Caption Embedding Knowledge Pose Relation Caption Prediction PDF
2021-10-20 A Self-Explainable Stylish Image Captioning Framework via Multi-References Chengxi Li, Brent Harrison arXiv_CL arXiv_CL Image_Caption Multi_Modal Pose Caption PDF
2021-10-20 NOD: Taking a Closer Look at Detection under Extreme Low-Light Conditions with Night Object Detection Dataset Igor Morawski, Yu-An Chen, Yu-Sheng Lin, Winston H. Hsu arXiv_CV arXiv_CV Image_Caption Enhancement Pose Image_Enhancement Detection Object_Detection Attention PDF
2021-10-19 Open-domain clarification question generation without question examples Julia White, Gabriel Poesia, Robert Hawkins, Dorsa Sadigh, Noah Goodman arXiv_CL arXiv_CL Image_Caption Pose Caption PDF
2021-10-19 Unifying Multimodal Transformer for Bi-directional Image and Text Generation Yupan Huang, Hongwei Xue, Bei Liu, Yutong Lu arXiv_CV arXiv_CV Image_Caption Transformer Pose Action Text_Generation PDF
2021-10-18 Learning multiplane images from single views with self-supervision Gustavo Sutter P. Carvalho, Diogo C. Luvizon, Antonio Joia, Andre G. C. Pacheco, Otavio A. B. Penatti arXiv_CV arXiv_CV Image_Caption Zero-Shot PDF
2021-10-17 Contrastive Learning of Visual-Semantic Embeddings Anurag Jain, Yashaswi Verma arXiv_CV arXiv_CV Image_Caption Embedding Image_Retrieval Pose Contrastive_Learning Classification Image_Classification PDF
2021-10-16 A Good Prompt Is Worth Millions of Parameters? Low-resource Prompt-based Learning for Vision-Language Models Woojeong Jin, Yu Cheng, Yelong Shen, Weizhu Chen, Xiang Ren arXiv_CV arXiv_CV Image_Caption Transformer Zero-Shot Pose VQA Few-Shot GAN Caption Inference Language_Model QA PDF
2021-10-16 Self-Annotated Training for Controllable Image Captioning Zhangzi Zhu, Tianlei Wang, Hong Qu arXiv_AI arXiv_AI Image_Caption Transformer Pose Caption Matching PDF
2021-10-15 Gait-based Frailty Assessment using Image Representation of IMU Signals and Deep CNN Muhammad Zeeshan Arshad, Dawoon Jung, Mina Park, Hyungeun Shin, Jinwook Kim, Kyung-Ryoul Mun arXiv_CV arXiv_CV Image_Caption Pose Classification Deep_Learning Activity PDF
2021-10-14 Automatic Modeling of Social Concepts Evoked by Art Images as Multimodal Frames Delfina Sol Martinez Pandiani, Valentina Presutti arXiv_CV arXiv_CV Image_Caption Pose Ontology Action Detection PDF
2021-10-13 Benchmarking the Robustness of Spatial-Temporal Models Against Corruptions Chenyu Yi, SIYUAN YANG, Haoliang Li, Yap-peng Tan, Alex Kot arXiv_CV arXiv_CV Image_Caption Transformer Video_Caption PDF
2021-10-12 Robust Glare Detection: Review, Analysis, and Dataset Release Mahdi Abolfazli Esfahani, Han Wang arXiv_AI arXiv_AI Image_Caption Review Pose Face Action Detection Autonomous PDF
2021-10-12 Topic Scene Graph Generation by Attention Distillation from Caption W. Wang, R. Wang, X. Chen arXiv_CV arXiv_CV Image_Caption Relation Attention Caption PDF
2021-10-11 Semi-Autoregressive Image Captioning Xu Yan, Zhengcong Fei, Zekang Li, Shuhui Wang, Qingming Huang, Qi Tian arXiv_CV arXiv_CV Image_Caption Knowledge Pose Caption Inference PDF
2021-10-10 Can Audio Captions Be Evaluated with Image Caption Metrics? Zelin Zhou, Zhiling Zhang, Xuenan Xu, Zeyu Xie, Mengyue Wu, Kenny Q. Zhu arXiv_CL arXiv_CL Image_Caption Bert Pose Detection Relation Object_Detection Caption PDF
2021-10-09 Deep Long-Tailed Learning: A Survey Yifan Zhang, Bingyi Kang, Bryan Hooi, Shuicheng Yan, Jiashi Feng arXiv_CV arXiv_CV Image_Caption Recognition Review Pose Survey Deep_Learning PDF
2021-10-09 Focus Your Distribution: Coarse-to-Fine Non-Contrastive Learning for Anomaly Detection and Localization Ye Zheng, Xiang Wang, Rui Deng, Tianpeng Bao, Rui Zhao, Liwei Wu arXiv_AI arXiv_AI Image_Caption Unsupervised Pose Contrastive_Learning Detection PDF
2021-10-07 Scale Invariant Domain Generalization Image Recapture Detection Jinian Luo, Jie Guo, Weidong Qiu, Zheng Huang, Hong Hui arXiv_CV arXiv_CV Image_Caption Regularization Adversarial Pose Face Detection Relation PDF
2021-10-07 InfoSeg: Unsupervised Semantic Image Segmentation with Mutual Information Maximization Robert Harb, Patrick Knöbelreiter arXiv_CV arXiv_CV Image_Caption Segmentation Unsupervised Represenation_Learning Self-Supervised Pose Quantitative PDF
2021-10-07 End-to-End Supermask Pruning: Learning to Prune Image Captioning Models Jia Huei Tan, Chee Seng Chan, Joon Huang Chuah arXiv_CV arXiv_CV Image_Caption Transformer Sparse Pose Relation Attention Caption PDF
2021-10-06 Is An Image Worth Five Sentences? A New Look into Semantics for Image-Text Matching Ali Furkan Biten, Andres Mafla, Lluis Gomez, Dimosthenis Karatzas arXiv_AI arXiv_AI Image_Caption Embedding Pose Relation Caption Matching PDF
2021-10-04 Let there be a clock on the beach: Reducing Object Hallucination in Image Captioning Ali Furkan Biten, Lluis Gomez, Dimosthenis Karatzas arXiv_CV arXiv_CV Image_Caption Pose Caption PDF
2021-10-04 Learning Structural Representations for Recipe Generation and Food Retrieval Hao Wang, Guosheng Lin, Steven C. H. Hoi, Chunyan Miao arXiv_CV arXiv_CV Image_Caption Unsupervised Pose Caption PDF
2021-10-02 Implicit and Explicit Attention for Zero-Shot Learning Faisal Alamri, Anjan Dutta arXiv_CV arXiv_CV Image_Caption Transformer Zero-Shot Self-Supervised Pose Attention PDF
2021-10-01 Geometry Attention Transformer with Position-aware LSTMs for Image Captioning Chi Wang, Yulin Shen, Luping Ji arXiv_CV arXiv_CV Image_Caption Transformer RNN Pose Relation Attention Caption PDF
2021-09-29 Geometry-Entangled Visual Semantic Transformer for Image Captioning Ling Cheng, Wei Wei, Feida Zhu, Yong Liu, Chunyan Miao arXiv_CV arXiv_CV Image_Caption Transformer Pose Attention Caption PDF
2021-09-28 Self-supervised Point Cloud Prediction Using 3D Spatio-temporal Convolutional Networks Benedikt Mersch, Xieyuanli Chen, Jens Behley, Cyrill Stachniss arXiv_RO arXiv_RO Image_Caption Tracking Point_Cloud 3D Self-Supervised Pose CNN Autonomous Prediction PDF
2021-09-28 Neural Dependency Coding inspired Multimodal Fusion Shiv Shankar arXiv_AI arXiv_AI Image_Caption Recognition Speech Emotion Sentiment Speech_Recognition Caption PDF
2021-09-28 CIDEr-R: Robust Consensus-based Image Description Evaluation Gabriel Oliveira dos Santos, Esther Luna Colombini, Sandra Avila arXiv_CV arXiv_CV Image_Caption Caption PDF
2021-09-26 PETA: Photo Albums Event Recognition using Transformers Attention Tamar Glaser, Emanuel Ben-Baruch, Gilad Sharir, Nadav Zamir, Asaf Noy, Lihi Zelnik-Manor arXiv_CV arXiv_CV Image_Caption Transformer Recognition RNN Pose Classification Attention PDF
2021-09-23 Scene Graph Generation for Better Image Captioning? Maximilian Mozes, Martin Schmitt, Vladimir Golkov, Hinrich Schütze, Daniel Cremers arXiv_CV arXiv_CV Image_Caption Detection Relation Visual_Relation Caption PDF
2021-09-22 Caption Enriched Samples for Improving Hateful Memes Detection Efrat Blaier, Itzik Malkiel, Lior Wolf arXiv_AI arXiv_AI Image_Caption Classification Detection Caption Language_Model PDF
2021-09-21 TrOCR: Transformer-based Optical Character Recognition with Pre-trained Models Minghao Li, Tengchao Lv, Lei Cui, Yijuan Lu, Dinei Florencio, Cha Zhang, Zhoujun Li, Furu Wei arXiv_CV arXiv_CV Image_Caption Transformer Recognition OCR RNN Optical_Character Pose Text_Generation Language_Model PDF
2021-09-17 Cross Modification Attention Based Deliberation Model for Image Captioning Zheng Lian, Yanan Zhang, Haichang Li, Rui Wang, Xiaohui Hu arXiv_AI arXiv_AI Image_Caption Pose Attention Caption Prediction PDF
2021-09-16 Aesthetics and neural network image representations Romuald A. Janik arXiv_CV arXiv_CV Image_Caption GAN PDF
2021-09-16 Label-Attention Transformer with Geometrically Coherent Objects for Image Captioning Shikha Dubey, Farrukh Olimov, Muhammad Aasim Rafique, Joonmo Kim, Moongu Jeon arXiv_AI arXiv_AI Image_Caption Transformer Pose Quantitative Relation Attention Caption PDF
2021-09-15 Image Captioning for Effective Use of Language Models in Knowledge-Based Visual Question Answering Ander Salaberria, Gorka Azkune, Oier Lopez de Lacalle, Aitor Soroa, Eneko Agirre arXiv_AI arXiv_AI Image_Caption Knowledge Knowledge_Graph Pose VQA Caption Inference Language_Model QA PDF
2021-09-15 Uncertainty Quantification in Medical Image Segmentation with Multi-decoder U-Net Yanwu Yang, Xutao Guo, Yiwei Pan, Pengcheng Shi, Haiyan Lv, Ting Ma arXiv_AI arXiv_AI Image_Caption Segmentation Pose Medical Prediction PDF
2021-09-14 SafeAccess+: An Intelligent System to make Smart Home Safer and Americans with Disability Act Compliant Shahinur Alam arXiv_AI arXiv_AI Image_Caption Action Quantitative Activity PDF
2021-09-13 UniMS: A Unified Framework for Multimodal Summarization with Knowledge Distillation Zhengkun Zhang, Xiaojun Meng, Yasheng Wang, Xin Jiang, Qun Liu, Zhenglu Yang arXiv_CL arXiv_CL Image_Caption Salient Knowledge Pose Summarization Text_Generation Caption PDF
2021-09-11 COSMic: A Coherence-Aware Generation Metric for Image Descriptions Mert İnan, Piyush Sharma, Baber Khalid, Radu Soricut, Matthew Stone, Malihe Alikhani arXiv_AI arXiv_AI Image_Caption Bert Pose Relation Text_Generation Caption PDF
2021-09-11 Bornon: Bengali Image Captioning with Transformer-based Deep learning approach Faisal Muhammad Shah, Mayeesha Humaira, Md Abidur Rahman Khan Jim, Amit Saha Ami, Shimul Paul arXiv_CV arXiv_CV Image_Caption Transformer RNN Deep_Learning Attention Caption PDF
2021-09-10 MURAL: Multimodal, Multitask Retrieval Across Languages Aashi Jain, Mandy Guo, Krishna Srinivasan, Ting Chen, Sneha Kudugunta, Chao Jia, Yinfei Yang, Jason Baldridge arXiv_AI arXiv_AI Image_Caption Zero-Shot Caption Matching PDF
2021-09-10 Partially-supervised novel object captioning leveraging context from paired data Shashank Bujimalla, Mahesh Subedar, Omesh Tickoo arXiv_CV arXiv_CV Image_Caption Pose Detection Object_Detection Caption PDF
2021-09-10 An Empirical Study of GPT-3 for Few-Shot Knowledge-Based VQA Zhengyuan Yang, Zhe Gan, Jianfeng Wang, Xiaowei Hu, Yumao Lu, Zicheng Liu, Lijuan Wang arXiv_CV arXiv_CV Image_Caption Knowledge Pose VQA Few-Shot Caption Prediction QA PDF
2021-09-09 Towards Robust Cross-domain Image Understanding with Unsupervised Noise Removal Lei Zhu, Zhaojing Luo, Wei Wang, Meihui Zhang, Gang Chen, Kaiping Zheng arXiv_CV arXiv_CV Image_Caption Embedding Unsupervised Weakly_Supervised Knowledge Adversarial Pose Deep_Learning Medical PDF
2021-09-08 RefineCap: Concept-Aware Refinement for Image Captioning Yekun Chai, Shuo Jin, Junliang Xing arXiv_CL arXiv_CL Image_Caption Pose Caption Language_Model PDF
2021-09-08 Vision Matters When It Should: Sanity Checking Multimodal Machine Translation Models Jiaoda Li, Duygu Ataman, Rico Sennrich arXiv_CL arXiv_CL Image_Caption