Search Results for author: Qingye Meng

Found 3 papers, 2 papers with code

Improving Transformers with Dynamically Composable Multi-Head Attention

1 code implementation14 May 2024 Da Xiao, Qingye Meng, Shengping Li, Xingyuan Yuan

At the core of DCMHA is a $\it{Compose}$ function that transforms the attention score and weight matrices in an input-dependent way.

Language Modelling

PM2.5-GNN: A Domain Knowledge Enhanced Graph Neural Network For PM2.5 Forecasting

2 code implementations ACM SIGSPATIAL International Conference on Advances in Geographic Information Systems 2020 Shuo Wang, Yan-ran Li, Jiang Zhang, Qingye Meng, Lingwei Meng, Fei Gao

When predicting PM2. 5 concentrations, it is necessary to consider complex information sources since the concentrations are influenced by various factors within a long period.

Cannot find the paper you are looking for? You can Submit a new open access paper.