Search Results for author: Qiyuan Chen

Found 7 papers, 5 papers with code

Mind's Mirror: Distilling Self-Evaluation Capability and Comprehensive Thinking from Large Language Models

1 code implementation15 Nov 2023 Weize Liu, Guocong Li, Kai Zhang, Bang Du, Qiyuan Chen, Xuming Hu, Hongxia Xu, Jintai Chen, Jian Wu

While techniques such as chain-of-thought (CoT) distillation have displayed promise in distilling LLMs into small language models (SLMs), there is a risk that distilled SLMs may still inherit flawed reasoning and hallucinations from LLMs.

Transfer Learning

Pushing Large Language Models to the 6G Edge: Vision, Challenges, and Opportunities

no code implementations28 Sep 2023 Zheng Lin, Guanqiao Qu, Qiyuan Chen, Xianhao Chen, Zhe Chen, Kaibin Huang

In both aspects, considering the inherent resource limitations at the edge, we discuss various cutting-edge techniques, including split learning/inference, parameter-efficient fine-tuning, quantization, and parameter-sharing inference, to facilitate the efficient deployment of LLMs.

Edge-computing Quantization

ExcelFormer: Can a DNN be a Sure Bet for Tabular Prediction?

1 code implementation7 Jan 2023 Jintai Chen, Jiahuan Yan, Qiyuan Chen, Danny Ziyi Chen, Jian Wu, Jimeng Sun

In this paper, we delve into this question: Can we develop a deep learning model that serves as a "sure bet" solution for a wide range of tabular prediction tasks, while also being user-friendly for casual users?

Data Augmentation Model Selection

Reprint: a randomized extrapolation based on principal components for data augmentation

1 code implementation26 Apr 2022 Jiale Wei, Qiyuan Chen, Pai Peng, Benjamin Guedj, Le Li

This paper presents REPRINT, a simple and effective hidden-space data augmentation method for imbalanced data classification.

Data Augmentation text-classification +1

Cannot find the paper you are looking for? You can Submit a new open access paper.