no code implementations • 13 Sep 2022 • Charaf Eddine Benarab, Shenglin Gui
CNN-Trans-Enc is relatively small as a downstream classifier and doesn't require any fine-tuning of BERT, as it ensures an optimal use of the $[CLS]$ representations from all layers, leveraging different linguistic features with more meaningful, and generalizable QKV representations of the input.
no code implementations • 24 Aug 2021 • Jiaxuan Chen, Shenglin Gui
The text clustering technique is an unsupervised text mining method which are used to partition a huge amount of text documents into groups.