Search Results for author:
Found 6 papers, 0 papers with code
SpeechGuard: Exploring the Adversarial Robustness of Multimodal Large Language Models
Despite safety guardrails, experiments on jailbreaking demonstrate the vulnerability of SLMs to adversarial perturbations and transfer attacks, with average attack success rates of 90% and 10% respectively when evaluated on a dataset of carefully designed harmful questions spanning 12 different toxic categories.
SpeechVerse: A Large-scale Generalizable Audio Language Model
The models are instruction finetuned using continuous latent representations extracted from the speech foundation model to achieve optimal zero-shot performance on a diverse range of speech processing tasks using natural language instructions.
Audiovisual Highlight Detection in Videos
To better study the task of highlight detection, we run a pilot experiment with highlights annotations for a small subset of video clips and fine-tune our best model on it.
TILES-2018, a longitudinal physiologic and behavioral data set of hospital workers
We designed the study to investigate the use of off-the-shelf wearable and environmental sensors to understand individual-specific constructs such as job performance, interpersonal interaction, and well-being of hospital workers over time in their natural day-to-day job settings.
Characterizing dynamically varying acoustic scenes from egocentric audio recordings in workplace setting
In this paper, we address the task of characterizing acoustic scenes in a workplace setting from audio recordings collected with wearable microphones.
Generating Labels for Regression of Subjective Constructs using Triplet Embeddings
In this work, we propose a novel annotation approach using triplet embeddings.
