research
∙
09/15/2023
Chunked Attention-based Encoder-Decoder Model for Streaming Speech Recognition
We study a streamable attention-based encoder-decoder model in which eit...
share
research
∙
08/08/2023
Comparative Analysis of the wav2vec 2.0 Feature Extractor
Automatic speech recognition (ASR) systems typically use handcrafted fea...
research
∙
06/15/2023
Competitive and Resource Efficient Factored Hybrid HMM Systems are Simpler Than You Think
Building competitive hybrid hidden Markov model (HMM) systems for automa...
research
∙
06/08/2023
Improving Long Context Document-Level Machine Translation
Document-level context for neural machine translation (NMT) is crucial t...
research
∙
06/08/2023
On Search Strategies for Document-Level Neural Machine Translation
Compared to sentence-level systems, document-level neural machine transl...
research
∙
06/08/2023
Improving Language Model Integration for Neural Machine Translation
The integration of language models for neural machine translation has be...
research
∙
05/28/2023
RASR2: The RWTH ASR Toolkit for Generic Sequence-to-sequence Speech Recognition
Modern public ASR tools usually provide rich support for training variou...
research
∙
04/14/2023
Task-oriented Document-Grounded Dialog Systems by HLTPR@RWTH for DSTC9 and DSTC10
This paper summarizes our contributions to the document-grounded dialog ...
research
∙
01/11/2023
Improving And Analyzing Neural Speaker Embeddings for ASR
Neural speaker embeddings encode the speaker's speech characteristics th...
research
∙
12/07/2022
Lattice-Free Sequence Discriminative Training for Phoneme-Based Neural Transducers
Recently, RNN-Transducers have achieved remarkable results on various au...
research
∙
11/09/2022
Mask More and Mask Later: Efficient Pre-training of Masked Language Models by Disentangling the [MASK] Token
The pre-training of masked language models (MLMs) consumes massive compu...
research
∙
10/31/2022
Controllable Factuality in Document-Grounded Dialog Systems Using a Noisy Channel Model
In this work, we present a model for document-grounded response generati...
research
∙
10/26/2022
Efficient Use of Large Pre-Trained Models for Low Resource ASR
Automatic speech recognition (ASR) has been established as a well-perfor...
research
∙
10/26/2022
Monotonic segmental attention for automatic speech recognition
We introduce a novel segmental-attention model for automatic speech reco...
research
∙
10/24/2022
Development of Hybrid ASR Systems for Low Resource Medical Domain Conversational Telephone Speech
Language barriers present a great challenge in our increasingly connecte...
research
∙
10/24/2022
Does Joint Training Really Help Cascaded Speech Translation?
Currently, in speech translation, the straightforward approach - cascadi...
research
∙
10/21/2022
Is Encoder-Decoder Redundant for Neural Machine Translation?
Encoder-decoder architecture is widely adopted for sequence-to-sequence ...
research
∙
10/21/2022
Revisiting Checkpoint Averaging for Neural Machine Translation
Checkpoint averaging is a simple and effective method to boost the perfo...
research
∙
10/18/2022
HMM vs. CTC for Automatic Speech Recognition: Comparison Based on Full-Sum Training from Scratch
In this work, we compare from-scratch sequence-level cross-entropy (full...
research
∙
06/26/2022
Improving the Training Recipe for a Robust Conformer-based Hybrid Model
Speaker adaptation is important to build robust automatic speech recogni...
research
∙
04/22/2022
Efficient Training of Neural Transducer for Speech Recognition
As one of the most popular sequence-to-sequence modeling approaches for ...
research
∙
01/24/2022
Improving Factored Hybrid HMM Acoustic Modeling without State Tying
In this work, we show that a factored hybrid hidden Markov model (FH-HMM...
research
∙
12/16/2021
Adapting Document-Grounded Dialog Systems to Spoken Conversations using Data Augmentation and a Noisy Channel Model
This paper summarizes our submission to Task 2 of the second track of th...
research
∙
11/11/2021
Self-Normalized Importance Sampling for Neural Language Modeling
To mitigate the problem of having to traverse over the full vocabulary i...
research
∙
11/05/2021
Conformer-based Hybrid ASR System for Switchboard Dataset
The recently proposed conformer architecture has been successfully used ...
research
∙
10/18/2021
Automatic Learning of Subword Dependent Model Scales
To improve the performance of state-of-the-art automatic speech recognit...
research
∙
10/18/2021
Efficient Sequence Training of Attention Models using Approximative Recombination
Sequence discriminative training is a great tool to improve the performa...
research
∙
10/13/2021
On Language Model Integration for RNN Transducer based Speech Recognition
The mismatch between an external language model (LM) and the implicitly ...
research
∙
10/12/2021
Investigation on Data Adaptation Techniques for Neural Named Entity Recognition
Data processing is an important step in various natural language process...
research
∙
09/27/2021
Towards Reinforcement Learning for Pivot-based Neural Machine Translation with Non-autoregressive Transformer
Pivot-based neural machine translation (NMT) is commonly used in low-res...
research
∙
09/27/2021
Integrated Training for Sequence-to-Sequence Models Using Non-Autoregressive Transformer
Complex natural language applications such as speech translation or pivo...
research
∙
06/14/2021
Cascaded Span Extraction and Response Generation for Document-Grounded Dialog
This paper summarizes our entries to both subtasks of the first DialDoc ...
research
∙
05/31/2021
Why does CTC result in peaky behavior?
The peaky behavior of CTC models is well known experimentally. However, ...
research
∙
04/21/2021
On Sampling-Based Training Criteria for Neural Language Modeling
As the vocabulary size of modern word-based language models becomes ever...
research
∙
04/19/2021
Acoustic Data-Driven Subword Modeling for End-to-End Speech Recognition
Subword units are commonly used for end-to-end automatic speech recognit...
research
∙
04/13/2021
Equivalence of Segmental and Neural Transducer Modeling: A Proof of Concept
With the advent of direct models in automatic speech recognition (ASR), ...
research
∙
04/12/2021
Investigating Methods to Improve Language Model Integration for Attention-based Encoder-Decoder ASR Models
Attention-based encoder-decoder (AED) models learn an implicit internal ...
research
∙
04/12/2021
Comparing the Benefit of Synthetic Training Data for Various Automatic Speech Recognition Architectures
Recent publications on automatic-speech-recognition (ASR) have a strong ...
research
∙
04/09/2021
Feature Replacement and Combination for Hybrid ASR Systems
Acoustic modeling of raw waveform and learning feature extractors as par...
research
∙
04/07/2021
Librispeech Transducer Model with Internal Language Model Prior Correction
We present our transducer model on Librispeech. We study variants to inc...
research
∙
04/06/2021
Towards Consistent Hybrid HMM Acoustic Modeling
High-performance hybrid automatic speech recognition (ASR) systems are o...
research
∙
03/30/2021
A study of latent monotonic attention variants
End-to-end models reach state-of-the-art performance for speech recognit...
research
∙
02/09/2021
Efficient Retrieval Augmented Generation from Unstructured Knowledge for Task-Oriented Dialog
This paper summarizes our work on the first track of the ninth Dialog Sy...
research
∙
11/24/2020
Tight Integrated End-to-End Training for Cascaded Speech Translation
A cascaded speech translation model relies on discrete and non-different...
research
∙
11/24/2020
Two-Way Neural Machine Translation: A Proof of Concept for Bidirectional Translation Modeling using a Two-Dimensional Grid
Neural translation models have proven to be effective in capturing suffi...
research
∙
10/30/2020
Phoneme Based Neural Transducer for Large Vocabulary Speech Recognition
To join the advantages of classical and end-to-end approaches for speech...
research
∙
10/19/2020
Diving Deep into Context-Aware Neural Machine Translation
Context-aware neural machine translation (NMT) is a promising direction ...
research
∙
05/20/2020
Investigation of Large-Margin Softmax in Neural Language Modeling
To encourage intra-class compactness and inter-class separability among ...
research
∙
05/20/2020
Early Stage LM Integration Using Local and Global Log-Linear Combination
Sequence-to-sequence models with an implicit alignment mechanism (e.g. a...
research
∙
05/19/2020
