research
∙
09/20/2023
Chain-of-Verification Reduces Hallucination in Large Language Models
Generation of plausible yet incorrect factual information, termed halluc...
share
research
∙
08/11/2023
Self-Alignment with Instruction Backtranslation
We present a scalable method to build a high quality instruction followi...
research
∙
06/23/2023
System-Level Natural Language Feedback
Natural language (NL) feedback contains rich information about the user ...
research
∙
06/07/2023
The HCI Aspects of Public Deployment of Research Chatbots: A User Study, Design Recommendations, and Open Challenges
Publicly deploying research chatbots is a nuanced topic involving necess...
research
∙
06/07/2023
Improving Open Language Models by Learning from Organic Interactions
We present BlenderBot 3x, an update on the conversational model BlenderB...
research
∙
05/09/2023
Large Language Model Programs
In recent years, large pre-trained language models (LLMs) have demonstra...
research
∙
05/01/2023
Learning to Reason and Memorize with Self-Notes
Large language models have been shown to struggle with limited context m...
research
∙
04/26/2023
Multi-Party Chat: Conversational Agents in Group Settings with Humans and Models
Current dialogue research primarily studies pairwise (two-party) convers...
research
∙
02/14/2023
The Stable Entropy Hypothesis and Entropy-Aware Decoding: An Analysis and Algorithm for Robust Natural Language Generation
State-of-the-art language generation models can degenerate when applied ...
research
∙
01/13/2023
Infusing Commonsense World Models with Graph Knowledge
While language models have become more capable of producing compelling l...
research
∙
11/10/2022
The CRINGE Loss: Learning what language not to model
Standard language model training employs gold human documents or human-h...
research
∙
10/28/2022
When Life Gives You Lemons, Make Cherryade: Converting Feedback from Bad Responses into Good Labels
Deployed dialogue agents have the potential to integrate human feedback ...
research
∙
08/05/2022
Learning from data in the mixed adversarial non-adversarial case: Finding the helpers and ignoring the trolls
The promise of interaction between intelligent conversational agents and...
research
∙
08/05/2022
Learning New Skills after Deployment: Improving open-domain internet-driven dialogue with human feedback
Frozen models trained to mimic static datasets can never improve their p...
research
∙
08/05/2022
BlenderBot 3: a deployed conversational agent that continually learns to responsibly engage
We present BlenderBot 3, a 175B parameter dialogue model capable of open...
research
∙
06/15/2022
DIRECTOR: Generator-Classifiers For Supervised Language Modeling
Current language models achieve low perplexity but their resulting gener...
research
∙
03/24/2022
Language Models that Seek for Knowledge: Modular Search Generation for Dialogue and Prompt Completion
Language models (LMs) have recently been shown to generate more factual ...
research
∙
01/12/2022
Human Evaluation of Conversations is an Open Problem: comparing the sensitivity of various methods for evaluating dialogue agents
At the heart of improving conversational AI is the open problem of how t...
research
∙
12/10/2021
Am I Me or You? State-of-the-Art Dialogue Models Cannot Maintain an Identity
State-of-the-art dialogue models still often stumble with regards to fac...
research
∙
11/09/2021
Reason first, then respond: Modular Generation for Knowledge-infused Dialogue
Large language models can produce fluent dialogue but often hallucinate ...
research
∙
10/18/2021
NormFormer: Improved Transformer Pretraining with Extra Normalization
During pretraining, the Pre-LayerNorm transformer suffers from a gradien...
research
∙
07/15/2021
Beyond Goldfish Memory: Long-Term Open-Domain Conversation
Despite recent improvements in open-domain dialogue models, state of the...
research
∙
07/15/2021
Internet-Augmented Dialogue Generation
The largest store of continually updating knowledge on our planet can be...
research
∙
06/08/2021
Hash Layers For Large Sparse Models
We investigate the training of sparse layers that use different paramete...
research
∙
06/08/2021
Staircase Attention for Recurrent Processing of Sequences
Attention mechanisms have become a standard tool for sequence modeling t...
research
∙
05/13/2021
Not All Memories are Created Equal: Learning to Forget by Expiring
Attention mechanisms have shown promising results in sequence modeling t...
research
∙
04/15/2021
Retrieval Augmentation Reduces Hallucination in Conversation
Despite showing increasingly human-like conversational abilities, state-...
research
∙
12/24/2020
I like fish, especially dolphins: Addressing Contradictions in Dialogue Modeling
To quantify how well natural language understanding models can capture c...
research
∙
10/14/2020
Recipes for Safety in Open-domain Chatbots
Models trained on large unlabeled corpora of human interactions will lea...
research
∙
10/02/2020
Multi-Modal Open-Domain Dialogue
Recent work in open-domain conversational agents has demonstrated that s...
research
∙
10/01/2020
How to Motivate Your Dragon: Teaching Goal-Driven Agents to Speak and Act in Fantasy Worlds
We seek to create agents that both act and communicate with other agents...
research
∙
08/18/2020
Deploying Lifelong Open-Domain Dialogue Learning
Much of NLP research has focused on crowdsourced static datasets and the...
research
∙
06/22/2020
Open-Domain Conversational Agents: Current Progress, Open Problems, and Future Directions
We present our view of what is necessary to build an engaging open-domai...
research
∙
05/01/2020
Multi-Dimensional Gender Bias Classification
Machine learning models are trained to find patterns in data. NLP models...
research
∙
04/28/2020
Recipes for building an open-domain chatbot
Building open-domain chatbots is a challenging area for machine learning...
research
∙
04/17/2020
Can You Put it All Together: Evaluating Conversational Agents' Ability to Blend Skills
Being engaging, knowledgeable, and empathetic are all desirable general ...
research
∙
02/07/2020
I love your chain mail! Making knights smile in a fantasy game world: Open-domain goal-oriented dialogue agents
Dialogue research tends to distinguish between chit-chat and goal-orient...
research
∙
02/07/2020
I love your chain mail! Making knights smile in a fantasy game world: Open-domain goal-orientated dialogue agents
Dialogue research tends to distinguish between chit-chat and goal-orient...
research
∙
12/28/2019
All-in-One Image-Grounded Conversational Agents
As single-task accuracy on individual language and image tasks has impro...
research
∙
11/21/2019
Improving Conditioning in Context-Aware Sequence to Sequence Models
Neural sequence to sequence models are well established for applications...
research
∙
11/20/2019
Generating Interactive Worlds with Text
Procedurally generating cohesive and interesting game environments is ch...
research
∙
11/10/2019
Don't Say That! Making Inconsistent Dialogue Unlikely with Unlikelihood Training
Generative dialogue models currently suffer from a number of problems wh...
research
∙
11/10/2019
Queens are Powerful too: Mitigating Gender Bias in Dialogue Generation
Models often easily learn biases present in the training data, and their...
research
∙
11/09/2019
The Dialogue Dodecathlon: Open-Domain Knowledge and Image Grounded Conversational Agents
We introduce dodecaDialogue: a set of 12 tasks that measures if a conver...
research
∙
10/31/2019
Adversarial NLI: A New Benchmark for Natural Language Understanding
We introduce a new large-scale NLI benchmark dataset, collected via an i...
research
∙
09/12/2019
Finding Generalizable Evidence by Learning to Convince Q A Models
We propose a system that finds the strongest supporting evidence for a g...
research
∙
09/09/2019
Recommendation as a Communication Game: Self-Supervised Bot-Play for Goal-oriented Dialogue
Traditional recommendation systems produce static rather than interactiv...
research
∙
09/06/2019
ACUTE-EVAL: Improved Dialogue Evaluation with Optimized Questions and Multi-turn Comparisons
While dialogue remains an important end-goal of natural language researc...
research
∙
08/17/2019
Build it Break it Fix it for Dialogue Safety: Robustness from Adversarial Human Attack
The detection of offensive language in the context of a dialogue has bec...
research
∙
08/12/2019
