research
∙
04/27/2023
ChatVideo: A Tracklet-centric Multimodal and Versatile Video Understanding System
Existing deep video models are limited by specific tasks, fixed input-ou...
share
research
∙
04/23/2023
LaMD: Latent Motion Diffusion for Video Generation
Generating coherent and natural movement is the key challenge in video g...
research
∙
04/12/2023
Filler Word Detection with Hard Category Mining and Inter-Category Focal Loss
Filler words like “um" or “uh" are common in spontaneous speech. It is d...
research
∙
03/30/2023
Streaming Video Model
Video understanding tasks have traditionally been modeled by two separat...
research
∙
03/27/2023
Universal Few-shot Learning of Dense Prediction Tasks with Visual Token Matching
Dense prediction tasks are a fundamental class of problems in computer v...
research
∙
03/21/2023
OmniTracker: Unifying Object Tracking by Tracking-with-Detection
Object tracking (OT) aims to estimate the positions of target objects in...
research
∙
12/13/2022
Look Before You Match: Instance Understanding Matters in Video Object Segmentation
Exploring dense matching between the current frame and past frames for l...
research
∙
10/24/2022
TridentSE: Guiding Speech Enhancement with 32 Global Tokens
In this paper, we present TridentSE, a novel architecture for speech enh...
research
∙
09/15/2022
OmniVL:One Foundation Model for Image-Language and Video-Language Tasks
This paper presents OmniVL, a new foundation model to support both image...
research
∙
08/09/2022
An Anchor-Free Detector for Continuous Speech Keyword Spotting
Continuous Speech Keyword Spotting (CSKWS) is a task to detect predefine...
research
∙
06/28/2022
RetrieverTTS: Modeling Decomposed Factors for Text-Based Speech Insertion
This paper proposes a new "decompose-and-edit" paradigm for the text-bas...
research
∙
06/14/2022
Peripheral Vision Transformer
Human vision possesses a special type of visual processing systems calle...
research
∙
02/24/2022
Retriever: Learning Content-Style Representation as a Token-Level Bipartite Graph
This paper addresses the unsupervised learning of content-style decompos...
research
∙
01/26/2022
When Shift Operation Meets Vision Transformer: An Extremely Simple Alternative to Attention Mechanism
Attention mechanism has been widely believed as the key to success of vi...
research
∙
12/06/2021
Make It Move: Controllable Image-to-Video Generation with Text Descriptions
Generating controllable videos conforming to user intentions is an appea...
research
∙
09/12/2021
Zero-Shot Text-to-Speech for Text-Based Insertion in Audio Narration
Given a piece of speech and its transcript text, text-based speech editi...
research
∙
09/12/2021
Sparse MLP for Image Recognition: Is Self-Attention Really Necessary?
Transformers have sprung up in the field of computer vision. In this wor...
research
∙
08/30/2021
A Battle of Network Structures: An Empirical Study of CNN, Transformer, and MLP
Convolutional neural networks (CNN) are the dominant deep neural network...
research
∙
08/18/2021
Self-Supervised Visual Representations Learning by Contrastive Mask Prediction
Advanced self-supervised visual representation learning methods rely on ...
research
∙
05/06/2021
Unsupervised Visual Representation Learning by Tracking Patches in Video
Inspired by the fact that human eyes continue to develop tracking abilit...
research
∙
02/03/2021
General-Purpose Speech Representation Learning through a Self-Supervised Multi-Granularity Framework
This paper presents a self-supervised learning framework, named MGF, for...
research
∙
01/28/2021
VAE^2: Preventing Posterior Collapse of Variational Video Predictions in the Wild
Predicting future frames of video sequences is challenging due to the co...
research
∙
04/10/2020
Spatiotemporal Fusion in 3D CNNs: A Probabilistic View
Despite the success in still image recognition, deep neural networks for...
research
∙
04/02/2020
Tracking by Instance Detection: A Meta-Learning Approach
We consider the tracking problem as a special type of object detection p...
research
∙
11/12/2019
PHASEN: A Phase-and-Harmonics-Aware Speech Enhancement Network
Time-frequency (T-F) domain masking is a mainstream approach for single-...
research
∙
06/23/2019
One-Shot Neural Architecture Search Through A Posteriori Distribution Guided Sampling
The emergence of one-shot approaches has greatly advanced the research o...
research
∙
04/09/2019
SPM-Tracker: Series-Parallel Matching for Real-Time Visual Object Tracking
The greatest challenge facing visual object tracking is the simultaneous...
research
∙
12/02/2018
Snorkel DryBell: A Case Study in Deploying Weak Supervision at Industrial Scale
Labeling training data is one of the most costly bottlenecks in developi...
research
∙
09/05/2018
Towards a Better Match in Siamese Network Based Visual Object Tracker
Recently, Siamese network based trackers have received tremendous intere...
research
∙
02/24/2018
