GRUBERT: A GRU-Based Method to Fuse BERT Hidden Layers for Twitter Sentiment Analysis

2 code implementations • Asian Chapter of the Association for Computational Linguistics 2020 • Leo Horne, Matthias Matti, Pouya Pourjafar, Zuowen Wang

In this work, we introduce a GRU-based architecture called GRUBERT that learns to map the different BERT hidden layers to fused embeddings with the aim of achieving high accuracy on the Twitter sentiment analysis task.

Twitter Sentiment Analysis