no code implementations • 28 Feb 2024 • Yichao Wu, Yafei Xiang, Shuning Huo, Yulu Gong, Penghao Liang
In addressing the computational and memory demands of fine-tuning Large Language Models(LLMs), we propose LoRA-SP(Streamlined Partial Parameter Adaptation), a novel approach utilizing randomized half-selective parameter freezing within the Low-Rank Adaptation(LoRA)framework.
no code implementations • 27 Feb 2024 • Mengran Zhu, Ye Zhang, Yulu Gong, Changxin Xu, Yafei Xiang
Credit card fraud detection is a critical challenge in the financial sector, demanding sophisticated approaches to accurately identify fraudulent transactions.
no code implementations • 25 Feb 2024 • Hanyi Yu, Shuning Huo, Mengran Zhu, Yulu Gong, Yafei Xiang
This paper introduces a deep learning-based prediction method for autonomous driving lane change behavior, aiming to facilitate safe lane changes and thereby improve road safety.
no code implementations • 25 Feb 2024 • Shuning Huo, Yafei Xiang, Hanyi Yu, Mengran Zhu, Yulu Gong
In recent years, advancements in natural language processing (NLP) have been fueled by deep learning techniques, particularly through the utilization of powerful computing resources like GPUs and TPUs.
no code implementations • 25 Feb 2024 • Yafei Xiang, Hanyi Yu, Yulu Gong, Shuning Huo, Mengran Zhu
With the rapid development of artificial intelligence technology, Transformer structural pre-training model has become an important tool for large language model (LLM) tasks.
no code implementations • 15 Feb 2024 • Mengran Zhu, Yulu Gong, Yafei Xiang, Hanyi Yu, Shuning Huo
Anomaly detection is a critical challenge across various research domains, aiming to identify instances that deviate from normal data distributions.
no code implementations • 15 Feb 2024 • Yulu Gong, Mengran Zhu, Shuning Huo, Yafei Xiang, Hanyi Yu
In the age of the Internet, people's lives are increasingly dependent on today's network technology.