no code implementations • 14 Apr 2024 • Qiang Hu, Jin Wen, Maxime Cordy, Yuheng Huang, Xiaofei Xie, Lei Ma
Large language models (LLMs) achieved great success in multiple application domains and attracted huge attention from different research communities recently.
no code implementations • 12 Apr 2024 • Xuan Xie, Jiayang Song, Zhehua Zhou, Yuheng Huang, Da Song, Lei Ma
To bridge this gap, we conduct in this work a comprehensive evaluation of the effectiveness of existing online safety analysis methods on LLMs.
1 code implementation • 6 Mar 2024 • Zhijie Wang, Yuheng Huang, Da Song, Lei Ma, Tianyi Zhang
However, prompting remains challenging for novice users due to the complexity of the stable diffusion model and the non-trivial efforts required for iteratively editing and refining the text prompts.
no code implementations • 22 Oct 2023 • Da Song, Xuan Xie, Jiayang Song, Derui Zhu, Yuheng Huang, Felix Juefei-Xu, Lei Ma
the trustworthiness perspective, is bound to and enriches the abstract model with semantics, which enables more detailed analysis applications for diverse purposes.
no code implementations • 8 Aug 2023 • Yu Pan, Yuguang Yang, Yuheng Huang, Jixun Yao, JingJing Yin, Yanni Hu, Heng Lu, Lei Ma, Jianjun Zhao
Despite notable progress, speech emotion recognition (SER) remains challenging due to the intricate and ambiguous nature of speech emotion, particularly in wild world.
no code implementations • 16 Jul 2023 • Yuheng Huang, Jiayang Song, Zhijie Wang, Shengming Zhao, Huaming Chen, Felix Juefei-Xu, Lei Ma
In particular, we experiment with twelve uncertainty estimation methods and four LLMs on four prominent natural language processing (NLP) tasks to investigate to what extent uncertainty estimation techniques could help characterize the prediction risks of LLMs.
no code implementations • 23 May 2023 • Zhixuan Zhang, Yuheng Huang, Dan Ou, Sen Li, Longbin Li, Qingwen Liu, Xiaoyi Zeng
As such, the metric of a pre-ranking model follows the ranking model using Area Under ROC (AUC) for offline evaluation.
1 code implementation • 2 Mar 2023 • Zhijie Wang, Yuheng Huang, Da Song, Lei Ma, Tianyi Zhang
The core of DeepSeer is a state abstraction method that bundles semantically similar hidden states in an RNN model and abstracts the model as a finite state machine.
1 code implementation • 2 Mar 2023 • Da Song, Zhijie Wang, Yuheng Huang, Lei Ma, Tianyi Zhang
In this work, we propose DeepLens, an interactive system that helps users detect and explore OOD issues in massive text corpora.
no code implementations • 13 Dec 2022 • Zhijie Wang, Yuheng Huang, Lei Ma, Haruki Yokoyama, Susumu Tokumoto, Kazuki Munakata
More importantly, it also lacks systematic investigation on how to perform the risk assessment for AI systems from unit level to system level.
no code implementations • 19 Nov 2021 • Yuheng Huang, Lei Ma, Yuanchun Li
Vision Transformer (ViT) is known to be highly nonlinear like other classical neural networks and could be easily fooled by both natural and adversarial patch perturbations.
1 code implementation • NeurIPS 2020 • Tao Zhuang, Zhixuan Zhang, Yuheng Huang, Xiaoyi Zeng, Kai Shuang, Xiang Li
Experimentally, we show that structured pruning using polarization regularizer achieves much better results than using L1 regularizer.