Search Results for author:
Found 5 papers, 1 papers with code
SpeechVerse: A Large-scale Generalizable Audio Language Model
The models are instruction finetuned using continuous latent representations extracted from the speech foundation model to achieve optimal zero-shot performance on a diverse range of speech processing tasks using natural language instructions.
Device Directedness with Contextual Cues for Spoken Dialog Systems
In this work, we define barge-in verification as a supervised learning task where audio-only information is used to classify user spoken dialogue into true and false barge-ins.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+2
Remember the context! ASR slot error correction through memorization
Accurate recognition of slot values such as domain specific words or named entities by automatic speech recognition (ASR) systems forms the core of the Goal-oriented Dialogue Systems.
Automatic Speech Recognition
Automatic Speech Recognition (ASR)
+3
Multimodal Semi-supervised Learning Framework for Punctuation Prediction in Conversational Speech
Experiments conducted on the Fisher corpus show that our proposed approach achieves ~6-9% and ~3-4% absolute improvement (F1 score) over the baseline BLSTM model on reference transcripts and ASR outputs respectively.
Text Generation from Knowledge Graphs with Graph Transformers
Generating texts which express complex ideas spanning multiple sentences requires a structured representation of their content (document plan), but these representations are prohibitively expensive to manually produce.
Ranked #6 on
KG-to-Text Generation
on AGENDA
