research
∙
06/22/2023
AudioPaLM: A Large Language Model That Can Speak and Listen
We introduce AudioPaLM, a large language model for speech understanding ...
share
research
∙
05/16/2023
SoundStorm: Efficient Parallel Audio Generation
We present SoundStorm, a model for efficient, non-autoregressive audio g...
research
∙
02/07/2023
Speak, Read and Prompt: High-Fidelity Text-to-Speech with Minimal Supervision
We introduce SPEAR-TTS, a multi-speaker text-to-speech (TTS) system that...
research
∙
09/07/2022
AudioLM: a Language Modeling Approach to Audio Generation
We introduce AudioLM, a framework for high-quality audio generation with...
research
∙
03/30/2022
Generative Spoken Dialogue Language Modeling
We introduce dGSLM, the first "textless" model able to generate audio sa...
research
∙
02/15/2022
textless-lib: a Library for Textless Spoken Language Processing
Textless spoken language processing research aims to extend the applicab...
research
∙
11/14/2021
Textless Speech Emotion Conversion using Decomposed and Discrete Representations
Speech emotion conversion is the task of modifying the perceived emotion...
research
∙
10/06/2021
How BPE Affects Memorization in Transformers
Training data memorization in NLP can both be beneficial (e.g., closed-b...
research
∙
09/07/2021
Text-Free Prosody-Aware Generative Spoken Language Modeling
Speech pre-training has primarily demonstrated efficacy on classificatio...
research
∙
07/03/2021
Can Transformers Jump Around Right in Natural Language? Assessing Performance Transfer from SCAN
Despite their practical success, modern seq2seq architectures are unable...
research
∙
06/08/2021
Interpretable agent communication from scratch (with a generic visual processor emerging on the side)
As deep networks begin to be deployed as autonomous agents, the issue of...
research
∙
04/29/2021
The Interspeech Zero Resource Speech Challenge 2021: Spoken language modelling
We present the Zero Resource Speech Challenge 2021, which asks participa...
research
∙
04/01/2021
Speech Resynthesis from Discrete Disentangled Self-Supervised Representations
We propose using self-supervised discrete representations for the task o...
research
∙
07/02/2020
Data Augmenting Contrastive Learning of Speech Representations in the Time Domain
Contrastive Predictive Coding (CPC), based on predicting future segments...
research
∙
06/26/2020
What they do when in doubt: a study of inductive biases in seq2seq learners
Sequence-to-sequence (seq2seq) learners are widely used, but we still ha...
research
∙
04/20/2020
Compositionality and Generalization in Emergent Languages
Natural language allows us to refer to novel composite concepts by combi...
research
∙
04/07/2020
Emergent Language Generalization and Acquisition Speed are not tied to Compositionality
Studies of discrete languages emerging when neural agents communicate to...
research
∙
07/01/2019
EGG: a toolkit for research on Emergence of lanGuage in Games
There is renewed interest in simulating language emergence among deep ne...
research
∙
05/31/2019
Information Minimization In Emergent Languages
There is a growing interest in studying the languages emerging when neur...
research
∙
05/29/2019
Anti-efficient encoding in emergent communication
Despite renewed interest in emergent language simulations with neural ne...
research
∙
05/29/2019
