research
∙
08/03/2023
The All-Seeing Project: Towards Panoptic Visual Recognition and Understanding of the Open World
We present the All-Seeing (AS) project: a large-scale data and model for...
share
research
∙
07/03/2023
JourneyDB: A Benchmark for Generative Image Understanding
While recent advancements in vision-language models have revolutionized ...
research
∙
06/08/2023
ADDP: Learning General Representations for Image Recognition and Generation with Alternating Denoising Diffusion Process
Image recognition and generation have long been developed independently ...
research
∙
06/08/2023
FlowFormer: A Transformer Architecture and Its Masked Cost Volume Autoencoding for Optical Flow
This paper introduces a novel transformer-based network architecture, Fl...
research
∙
06/02/2023
Denoising Diffusion Semantic Segmentation with Mask Prior Modeling
The evolution of semantic segmentation has long been dominated by learni...
research
∙
05/25/2023
Ghost in the Minecraft: Generally Capable Agents for Open-World Enviroments via Large Language Models with Text-based Knowledge and Memory
The captivating realm of Minecraft has attracted substantial research in...
research
∙
05/18/2023
VisionLLM: Large Language Model is also an Open-Ended Decoder for Vision-Centric Tasks
Large language models (LLMs) have notably accelerated progress towards a...
research
∙
05/09/2023
InternGPT: Solving Vision-Centric Tasks by Interacting with ChatGPT Beyond Language
We present an interactive visual framework named InternGPT, or iGPT for ...
research
∙
03/17/2023
Video Dehazing via a Multi-Range Temporal Alignment Network with Physical Prior
Video dehazing aims to recover haze-free frames with high visibility and...
research
∙
03/15/2023
VideoFlow: Exploiting Temporal Cues for Multi-frame Optical Flow Estimation
We introduce VideoFlow, a novel optical flow estimation framework for vi...
research
∙
03/02/2023
FeatAug-DETR: Enriching One-to-Many Matching for DETRs with Feature Augmentation
One-to-one matching is a crucial design in DETR-like object detection fr...
research
∙
03/02/2023
FlowFormer++: Masked Cost Volume Autoencoding for Pretraining Optical Flow Estimation
FlowFormer introduces a transformer architecture into optical flow estim...
research
∙
12/20/2022
Goal-oriented Autonomous Driving
Modern autonomous driving system is characterized as modular tasks in se...
research
∙
11/18/2022
BEVFormer v2: Adapting Modern Image Backbones to Bird's-Eye-View Recognition via Perspective Supervision
We present a novel bird's-eye-view (BEV) detector with perspective super...
research
∙
11/17/2022
Uni-Perceiver v2: A Generalist Model for Large-Scale Vision and Vision-Language Tasks
Despite the remarkable success of foundation models, their task-specific...
research
∙
11/17/2022
Towards All-in-one Pre-training via Maximizing Multi-modal Mutual Information
To effectively exploit the potential of large-scale models, various pre-...
research
∙
11/10/2022
Demystify Transformers Convolutions in Modern Image Deep Networks
Recent success of vision transformers has inspired a series of vision ba...
research
∙
11/10/2022
InternImage: Exploring Large-Scale Vision Foundation Models with Deformable Convolutions
Compared to the great progress of large-scale vision transformers (ViTs)...
research
∙
08/06/2022
Frozen CLIP Models are Efficient Video Learners
Video recognition has been dominated by the end-to-end learning paradigm...
research
∙
07/19/2022
Tip-Adapter: Training-free Adaption of CLIP for Few-shot Classification
Contrastive Vision-Language Pre-training, known as CLIP, has provided a ...
research
∙
06/09/2022
Uni-Perceiver-MoE: Learning Sparse Generalist Models with Conditional MoEs
To build an artificial neural network like the biological intelligence s...
research
∙
06/02/2022
Siamese Image Modeling for Self-Supervised Vision Representation Learning
Self-supervised learning (SSL) has delivered superior performance on a v...
research
∙
05/17/2022
Vision Transformer Adapter for Dense Predictions
This work investigates a simple yet powerful adapter for Vision Transfor...
research
∙
05/08/2022
ConvMAE: Masked Convolution Meets Masked Autoencoders
Vision Transformers (ViT) become widely-adopted architectures for variou...
research
∙
03/31/2022
BEVFormer: Learning Bird's-Eye-View Representation from Multi-Camera Images via Spatiotemporal Transformers
3D visual perception tasks, including 3D detection and map segmentation ...
research
∙
03/30/2022
FlowFormer: A Transformer Architecture for Optical Flow
We introduce Optical Flow TransFormer (FlowFormer), a transformer-based ...
research
∙
12/09/2021
Exploring the Equivalence of Siamese Self-Supervised Learning via A Unified Gradient Framework
Self-supervised learning has shown its great potential to extract powerf...
research
∙
12/09/2021
Searching Parameterized AP Loss for Object Detection
Loss functions play an important role in training deep-network-based obj...
research
∙
12/02/2021
Uni-Perceiver: Pre-training Unified Architecture for Generic Perception for Zero-shot and Few-shot Tasks
Biological intelligence systems of animals perceive the world by integra...
research
∙
11/26/2021
VL-LTR: Learning Class-wise Visual-Linguistic Representation for Long-Tailed Visual Recognition
Deep learning-based models encounter challenges when processing long-tai...
research
∙
11/06/2021
Tip-Adapter: Training-free CLIP-Adapter for Better Vision-Language Modeling
Contrastive Vision-Language Pre-training, known as CLIP, has provided a ...
research
∙
09/07/2021
FuseFormer: Fusing Fine-Grained Information in Transformers for Video Inpainting
Transformer, as a strong and flexible architecture for modelling long-ra...
research
∙
08/20/2021
Influence Selection for Active Learning
The existing active learning methods select the samples by evaluating th...
research
∙
07/02/2021
Collaborative Visual Navigation
As a fundamental problem for Artificial Intelligence, multi-agent system...
research
∙
06/04/2021
Scalable Transformers for Neural Machine Translation
Transformer has been widely adopted in Neural Machine Translation (NMT) ...
research
∙
04/14/2021
Decoupled Spatial-Temporal Transformer for Video Inpainting
Video inpainting aims to fill the given spatiotemporal holes with realis...
research
∙
03/25/2021
AutoLoss-Zero: Searching Loss Functions from Scratch for Generic Tasks
Significant progress has been achieved in automating the design of vario...
research
∙
01/28/2021
Exploring Cross-Image Pixel Contrast for Semantic Segmentation
Current semantic segmentation methods focus only on mining "local" conte...
research
∙
01/19/2021
Fast Convergence of DETR with Spatially Modulated Co-Attention
The recently proposed Detection Transformer (DETR) model successfully ap...
research
∙
11/25/2020
Unsupervised Object Detection with LiDAR Clues
Despite the importance of unsupervised object detection, to the best of ...
research
∙
10/15/2020
Auto Seg-Loss: Searching Metric Surrogates for Semantic Segmentation
We propose a general framework for searching surrogate losses for mainst...
research
∙
10/08/2020
Deformable DETR: Deformable Transformers for End-to-End Object Detection
DETR has been recently proposed to eliminate the need for many hand-desi...
research
∙
09/03/2020
1st Place Solution of LVIS Challenge 2020: A Good Box is not a Guarantee of a Good Mask
This article introduces the solutions of the team lvisTraveler for LVIS ...
research
∙
07/03/2020
Mining Cross-Image Semantics for Weakly Supervised Semantic Segmentation
This paper studies the problem of learning semantic segmentation from im...
research
∙
03/16/2020
Resolution Adaptive Networks for Efficient Inference
Recently, adaptive inference is gaining increasing attention due to its ...
research
∙
03/10/2020
Hierarchical Human Parsing with Typed Part-Relation Reasoning
Human parsing is for pixel-wise human semantic understanding. As human b...
research
∙
10/07/2019
Deformable Kernels: Adapting Effective Receptive Fields for Object Deformation
Convolutional networks are not aware of an object's geometric variations...
research
∙
08/22/2019
VL-BERT: Pre-training of Generic Visual-Linguistic Representations
We introduce a new pre-trainable generic representation for visual-lingu...
research
∙
06/17/2019
MMDetection: Open MMLab Detection Toolbox and Benchmark
We present MMDetection, an object detection toolbox that contains a rich...
research
∙
04/11/2019
