research
∙
06/08/2023
BOOT: Data-free Distillation of Denoising Diffusion Models with Bootstrapping
Diffusion models have demonstrated excellent potential for generating di...
share
research
∙
06/05/2023
PLANNER: Generating Diversified Paragraph via Latent Language Diffusion Model
Autoregressive models for text sometimes generate repetitive and low-qua...
research
∙
04/13/2023
Learning Controllable 3D Diffusion Models from Single-view Images
Diffusion models have recently become the de-facto approach for generati...
research
∙
03/11/2023
Stabilizing Transformer Training by Preventing Attention Entropy Collapse
Training stability is of great importance to Transformers. In this work,...
research
∙
03/07/2023
TRACT: Denoising Diffusion Models with Transitive Closure Time-Distillation
Denoising Diffusion models have demonstrated their proficiency for gener...
research
∙
10/10/2022
f-DM: A Multi-stage Diffusion Model via Progressive Signal Transformation
Diffusion models (DMs) have recently emerged as SoTA tools for generativ...
research
∙
07/27/2022
GAUDI: A Neural Architect for Immersive 3D Scene Generation
We introduce GAUDI, a generative model capable of capturing the distribu...
research
∙
07/15/2022
Position Prediction as an Effective Pretraining Strategy
Transformers have gained increasing popularity in a wide range of applic...
research
∙
06/10/2022
The Slingshot Mechanism: An Empirical Study of Adaptive Optimizers and the Grokking Phenomenon
The grokking phenomenon as reported by Power et al. ( arXiv:2201.02177 )...
research
∙
02/04/2022
Learning Representation from Neural Fisher Kernel with Low-rank Approximation
In this paper, we study the representation of neural networks from the v...
research
∙
12/02/2021
Robust Robotic Control from Pixels using Contrastive Recurrent State-Space Models
Modeling the world can benefit robot learning by providing a rich traini...
research
∙
09/16/2021
Regularized Training of Nearest Neighbor Language Models
Including memory banks in a natural language processing architecture inc...
research
∙
07/01/2021
Implicit Acceleration and Feature Learning in Infinitely Wide Neural Networks with Bottlenecks
We analyze the learning dynamics of infinitely wide neural networks with...
research
∙
05/28/2021
An Attention Free Transformer
We introduce Attention Free Transformer (AFT), an efficient variant of T...
research
∙
05/17/2021
Uncertainty Weighted Actor-Critic for Offline Reinforcement Learning
Offline Reinforcement Learning promises to learn effective policies from...
research
∙
04/21/2021
MetricOpt: Learning to Optimize Black-Box Evaluation Metrics
We study the problem of directly optimizing arbitrary non-differentiable...
research
∙
06/27/2020
On the generalization of learning-based 3D reconstruction
State-of-the-art learning-based monocular 3D reconstruction methods lear...
research
∙
06/18/2020
Set Distribution Networks: a Generative Model for Sets of Images
Images with shared characteristics naturally form sets. For example, in ...
research
∙
06/13/2020
Collegial Ensembles
Modern neural network performance typically improves as model size incre...
research
∙
10/29/2019
Adversarial Fisher Vectors for Unsupervised Representation Learning
We examine Generative Adversarial Networks (GANs) through the lens of de...
research
∙
10/28/2019
Skip-Clip: Self-Supervised Spatiotemporal Representation Learning by Future Clip Order Ranking
Deep neural networks require collecting and annotating large amounts of ...
research
∙
05/15/2019
Addressing the Loss-Metric Mismatch with Adaptive Loss Alignment
In most machine learning training paradigms a fixed, often handcrafted, ...
research
∙
11/14/2017
A Deep Learning Approach for Expert Identification in Question Answering Communities
In this paper, we describe an effective convolutional neural network fra...
research
∙
09/06/2017
Boosting Deep Learning Risk Prediction with Generative Adversarial Networks for Electronic Health Records
The rapid growth of Electronic Health Records (EHRs), as well as the acc...
research
∙
11/26/2016
Structural Correspondence Learning for Cross-lingual Sentiment Classification with One-to-many Mappings
Structural correspondence learning (SCL) is an effective method for cros...
research
∙
11/16/2016
Fully-adaptive Feature Sharing in Multi-Task Networks with Applications in Person Attribute Classification
Multi-task learning aims to improve generalization performance of multip...
research
∙
11/16/2016
S3Pool: Pooling with Stochastic Spatial Sampling
Feature pooling layers (e.g., max pooling) in convolutional neural netwo...
research
∙
05/25/2016
