research
∙
06/13/2023
Efficient Adapters for Giant Speech Models
Large pre-trained speech models are widely used as the de-facto paradigm...
share
research
∙
03/31/2023
Extracting Thyroid Nodules Characteristics from Ultrasound Reports Using Transformer-based Natural Language Processing Methods
The ultrasound characteristics of thyroid nodules guide the evaluation o...
research
∙
03/24/2023
VILA: Learning Image Aesthetics from User Comments with Vision-Language Pretraining
Assessing the aesthetics of an image is challenging, as it is influenced...
research
∙
03/02/2023
Google USM: Scaling Automatic Speech Recognition Beyond 100 Languages
We introduce the Universal Speech Model (USM), a single large model that...
research
∙
12/20/2022
AnyTOD: A Programmable Task-Oriented Dialog System
We propose AnyTOD, an end-to-end task-oriented dialog (TOD) system with ...
research
∙
08/28/2022
Training Text-To-Speech Systems From Synthetic Data: A Practical Approach For Accent Transfer Tasks
Transfer tasks in text-to-speech (TTS) synthesis - where one or more asp...
research
∙
07/13/2022
N-Grammer: Augmenting Transformers with latent n-grams
Transformer models have recently emerged as one of the foundational mode...
research
∙
06/22/2022
Scaling Autoregressive Models for Content-Rich Text-to-Image Generation
We present the Pathways Autoregressive Text-to-Image (Parti) model, whic...
research
∙
05/09/2022
Building Machine Translation Systems for the Next Thousand Languages
In this paper we share findings from our effort to build practical machi...
research
∙
05/04/2022
CoCa: Contrastive Captioners are Image-Text Foundation Models
Exploring large-scale pretrained foundation models is of significant int...
research
∙
04/08/2022
Show, Don't Tell: Demonstrations Outperform Descriptions for Schema-Guided Task-Oriented Dialogue
Building universal dialogue systems that can seamlessly operate across m...
research
∙
03/23/2022
Pathways: Asynchronous Distributed Dataflow for ML
We present the design of a new large scale orchestration layer for accel...
research
∙
02/03/2022
Self-supervised Learning with Random-projection Quantizer for Speech Recognition
We present a simple and effective self-supervised learning approach for ...
research
∙
01/21/2022
Description-Driven Task-Oriented Dialog Modeling
Task-oriented dialogue (TOD) systems are required to identify key inform...
research
∙
12/13/2021
GLaM: Efficient Scaling of Language Models with Mixture-of-Experts
Scaling language models with more data, compute and parameters has drive...
research
∙
10/13/2021
SGD-X: A Benchmark for Robust Generalization in Schema-Guided Dialogue Systems
Zero/few-shot transfer to unseen services is a critical challenge in tas...
research
∙
10/09/2021
Vector-quantized Image Modeling with Improved VQGAN
Pretraining language models with next-token prediction on massive text c...
research
∙
09/27/2021
BigSSL: Exploring the Frontier of Large-Scale Semi-Supervised Learning for Automatic Speech Recognition
We summarize the results of a host of efforts using giant automatic spee...
research
∙
08/31/2021
Effective Sequence-to-Sequence Dialogue State Tracking
Sequence-to-sequence models have been applied to a wide variety of NLP t...
research
∙
08/07/2021
W2v-BERT: Combining Contrastive Learning and Masked Language Modeling for Self-Supervised Speech Pre-Training
Motivated by the success of masked language modeling (MLM) in pre-traini...
research
∙
05/10/2021
GSPMD: General and Scalable Parallelization for ML Computation Graphs
We present GSPMD, an automatic, compiler-based parallelization system fo...
research
∙
03/28/2021
PnG BERT: Augmented BERT on Phonemes and Graphemes for Neural TTS
This paper introduces PnG BERT, a new encoder model for neural TTS. This...
research
∙
03/26/2021
Parallel Tacotron 2: A Non-Autoregressive Neural TTS Model with Differentiable Duration Modeling
This paper introduces Parallel Tacotron 2, a non-autoregressive neural t...
research
∙
02/27/2021
Improving Longer-range Dialogue State Tracking
Dialogue state tracking (DST) is a pivotal component in task-oriented di...
research
∙
01/21/2021
Distilling Interpretable Models into Human-Readable Code
The goal of model distillation is to faithfully transfer teacher model k...
research
∙
11/21/2020
A Better and Faster End-to-End Model for Streaming ASR
End-to-end (E2E) models have shown to outperform state-of-the-art conven...
research
∙
10/22/2020
Parallel Tacotron: Non-Autoregressive and Controllable TTS
Although neural end-to-end text-to-speech models can synthesize highly n...
research
∙
10/21/2020
FastEmit: Low-latency Streaming ASR with Sequence-level Emission Regularization
Streaming automatic speech recognition (ASR) aims to emit each hypothesi...
research
∙
10/20/2020
Pushing the Limits of Semi-Supervised Learning for Automatic Speech Recognition
We employ a combination of recent developments in semi-supervised learni...
research
∙
10/12/2020
Universal ASR: Unify and Improve Streaming ASR with Full-context Modeling
Streaming automatic speech recognition (ASR) aims to emit each hypothesi...
research
∙
10/08/2020
Non-Attentive Tacotron: Robust and Controllable Neural TTS Synthesis Including Unsupervised Duration Modeling
This paper presents Non-Attentive Tacotron based on the Tacotron 2 text-...
research
∙
05/19/2020
Improved Noisy Student Training for Automatic Speech Recognition
Recently, a semi-supervised learning method known as "noisy student trai...
research
∙
05/16/2020
Conformer: Convolution-augmented Transformer for Speech Recognition
Recently Transformer and Convolution neural network (CNN) based models h...
research
∙
05/11/2020
Leveraging Monolingual Data with Self-Supervision for Multilingual Neural Machine Translation
Over the last few years two promising research directions in low-resourc...
research
∙
05/07/2020
RNN-T Models Fail to Generalize to Out-of-Domain Audio: Causes and Solutions
In recent years, all-neural end-to-end approaches have obtained state-of...
research
∙
05/07/2020
ContextNet: Improving Convolutional Neural Networks for Automatic Speech Recognition with Global Context
Convolutional neural networks (CNN) have shown promising results for end...
research
∙
05/06/2020
Interpretable Learning-to-Rank with Generalized Additive Models
Interpretability of learning-to-rank models is a crucial yet relatively ...
research
∙
03/28/2020
A Streaming On-Device End-to-End Model Surpassing Server-Side Conventional Model Quality and Latency
Thus far, end-to-end (E2E) models have not been shown to outperform stat...
research
∙
02/06/2020
Fully-hierarchical fine-grained prosody modeling for interpretable speech synthesis
This paper proposes a hierarchical, fine-grained and interpretable laten...
research
∙
02/06/2020
Generating diverse and natural text-to-speech samples using a quantized fine-grained VAE and auto-regressive prosody prior
Recent neural text-to-speech (TTS) models with fine-grained latent featu...
research
∙
12/11/2019
SpecAugment on Large Scale Datasets
Recently, SpecAugment, an augmentation scheme for automatic speech recog...
research
∙
11/06/2019
A comparison of end-to-end models for long-form speech recognition
End-to-end automatic speech recognition (ASR) models, including both att...
research
∙
10/01/2019
Identifying Cancer Patients at Risk for Heart Failure Using Machine Learning Methods
Cardiotoxicity related to cancer therapies has become a serious issue, d...
research
∙
09/25/2019
Speech Recognition with Augmented Synthesized Speech
Recent success of the Tacotron speech synthesis architecture and its var...
research
∙
09/11/2019
Large-Scale Multilingual Speech Recognition with a Streaming End-to-End Model
Multilingual end-to-end (E2E) models have shown great promise in expansi...
research
∙
08/29/2019
Two-Pass End-to-End Speech Recognition
The requirements for many applications of state-of-the-art speech recogn...
research
∙
07/11/2019
Massively Multilingual Neural Machine Translation in the Wild: Findings and Challenges
We introduce our efforts towards building a universal neural machine tra...
research
∙
07/09/2019
Learning to Speak Fluently in a Foreign Language: Multilingual Speech Synthesis and Cross-Language Voice Cloning
We present a multispeaker, multilingual text-to-speech (TTS) synthesis m...
research
∙
04/12/2019
Direct speech-to-speech translation with a sequence-to-sequence model
We present an attention-based sequence-to-sequence neural network which ...
research
∙
04/05/2019
