no code implementations • 28 May 2024 • Chengyuan Liu, Shihang Wang, Yangyang Kang, Lizhi Qing, Fubang Zhao, Changlong Sun, Kun Kuang, Fei Wu
The objective of GCI is not merely to retain previously acquired general capabilities alongside new domain knowledge, but to harmonize and utilize both sets of skills in a cohesive manner to enhance performance on domain-specific tasks.
no code implementations • 11 Mar 2024 • Chengyuan Liu, Yangyang Kang, Fubang Zhao, Kun Kuang, Zhuoren Jiang, Changlong Sun, Fei Wu
In this paper, we propose EvoKD: Evolving Knowledge Distillation, which leverages the concept of active learning to interactively enhance the process of data generation using large language models, simultaneously improving the task capabilities of small domain model (student model).
1 code implementation • 21 Sep 2023 • Chengyuan Liu, Fubang Zhao, Lizhi Qing, Yangyang Kang, Changlong Sun, Kun Kuang, Fei Wu
There are several black-box attack methods, such as Prompt Attack, which can change the behaviour of LLMs and induce LLMs to generate unexpected answers with harmful contents.
1 code implementation • 21 Sep 2023 • Kai Zhang, Yangyang Kang, Fubang Zhao, Xiaozhong Liu
We contend that a mere memory module is inadequate and fully training an LLM can be excessively costly.
no code implementations • 20 Jul 2023 • Kaiwen Wei, Jie Yao, Jingyuan Zhang, Yangyang Kang, Fubang Zhao, Yating Zhang, Changlong Sun, Xin Jin, Xin Zhang
Firstly, the layout of existing datasets is relatively fixed and limited in the number of semantic entity categories, creating a significant gap between these datasets and the complex real-world scenarios.
no code implementations • 28 Apr 2023 • Chengyuan Liu, Fubang Zhao, Yangyang Kang, Jingyuan Zhang, Xiang Zhou, Changlong Sun, Kun Kuang, Fei Wu
In addition, we propose RexUIE, which is a Recursive Method with Explicit Schema Instructor for UIE.
1 code implementation • Findings (ACL) 2021 • Fubang Zhao, Zhuoren Jiang, Yangyang Kang, Changlong Sun, Xiaozhong Liu
Relational fact extraction aims to extract semantic triplets from unstructured text.
Ranked #4 on Relation Extraction on NYT
no code implementations • 24 Sep 2019 • Ying Ju, Fubang Zhao, Shijie Chen, Bowen Zheng, Xuefeng Yang, Yunfeng Liu
Conversational Question Answering is a challenging task since it requires understanding of conversational history.