research
∙
05/29/2023
Brainformers: Trading Simplicity for Efficiency
Transformers are central to recent successes in natural language process...
share
research
∙
07/02/2022
Rationale-Augmented Ensembles in Language Models
Recent research has shown that rationales, or step-by-step chains of tho...
research
∙
05/21/2022
Least-to-Most Prompting Enables Complex Reasoning in Large Language Models
We propose a novel prompting strategy, least-to-most prompting, that ena...
research
∙
04/15/2022
Resource-Constrained Neural Architecture Search on Tabular Datasets
The best neural architecture for a given machine learning problem depend...
research
∙
04/11/2022
The Carbon Footprint of Machine Learning Training Will Plateau, Then Shrink
Machine Learning (ML) workloads have rapidly grown in importance, but ra...
research
∙
03/21/2022
Self-Consistency Improves Chain of Thought Reasoning in Language Models
We explore a simple ensemble strategy, self-consistency, that significan...
research
∙
02/18/2022
Mixture-of-Experts with Expert Choice Routing
Sparsely-activated Mixture-of-experts (MoE) models allow the number of p...
research
∙
01/28/2022
Chain of Thought Prompting Elicits Reasoning in Large Language Models
Although scaling up language model size has reliably improved performanc...
research
∙
08/16/2021
Program Synthesis with Large Language Models
This paper explores the limits of the current generation of large langua...
research
∙
05/26/2021
A Full-Stack Search Technique for Domain Optimized Deep Learning Accelerators
The rapidly-changing deep learning landscape presents a unique opportuni...
research
∙
04/21/2021
Carbon Emissions and Large Neural Network Training
The computation demand for machine learning (ML) has grown rapidly recen...
research
∙
04/05/2021
SpeechStew: Simply Mix All Available Speech Recognition Data to Train One Large Neural Network
We present SpeechStew, a speech recognition model that is trained on a c...
research
∙
02/10/2021
Searching for Fast Model Families on Datacenter Accelerators
Neural Architecture Search (NAS), together with model scaling, has shown...
research
∙
10/30/2020
Training EfficientNets at Supercomputer Scale: 83 Accuracy in One Hour
EfficientNets are a family of state-of-the-art image classification mode...
research
∙
10/22/2020
Efficient Scale-Permuted Backbone with Learned Resource Distribution
Recently, SpineNet has demonstrated promising results on object detectio...
research
∙
08/13/2020
Can weight sharing outperform random architecture search? An investigation with TuNAS
Efficient Neural Architecture Search methods based on weight sharing hav...
research
∙
03/24/2020
BigNAS: Scaling Up Neural Architecture Search with Big Single-Stage Models
Neural architecture search (NAS) has shown promising results discovering...
research
∙
04/22/2019
Using Videos to Evaluate Image Model Robustness
Human visual systems are robust to a wide range of image transformations...
research
∙
08/08/2018
Backprop Evolution
The back-propagation algorithm is the cornerstone of deep learning. Desp...
research
∙
07/06/2018
Memory Augmented Policy Optimization for Program Synthesis with Generalization
This paper presents Memory Augmented Policy Optimization (MAPO): a novel...
research
∙
01/24/2018
Scalable and accurate deep learning for electronic health records
Predictive modeling with electronic health record (EHR) data is anticipa...
research
∙
03/29/2017
Tacotron: Towards End-to-End Speech Synthesis
A text-to-speech synthesis system typically consists of multiple stages,...
research
∙
03/11/2017
Massive Exploration of Neural Machine Translation Architectures
Neural Machine Translation (NMT) has shown remarkable progress over the ...
research
∙
03/03/2017
Large-Scale Evolution of Image Classifiers
Neural networks have proven effective at solving difficult problems but ...
research
∙
01/23/2017
Outrageously Large Neural Networks: The Sparsely-Gated Mixture-of-Experts Layer
The capacity of a neural network to absorb information is limited by its...
research
∙
12/04/2016
Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision (Short Version)
Extending the success of deep neural networks to natural language unders...
research
∙
10/31/2016
Neural Symbolic Machines: Learning Semantic Parsers on Freebase with Weak Supervision
Harnessing the statistical power of neural networks to perform language ...
research
∙
10/10/2016
Latent Sequence Decompositions
We present the Latent Sequence Decompositions (LSD) framework. LSD decom...
research
∙
06/19/2015
A Neural Conversational Model
Conversational modeling is an important task in natural language underst...
research
∙
12/19/2013
