1 code implementation • 16 Apr 2024 • Jianqi Zhang, Jingyao Wang, Wenwen Qiang, Fanjiang Xu, Changwen Zheng, Fuchun Sun, Hui Xiong
Motivated by these findings, we introduce two new PEs: Temporal Position Encoding (T-PE) for temporal tokens and Variable Positional Encoding (V-PE) for variable tokens.
1 code implementation • 10 Dec 2023 • Jingyao Wang, Yi Ren, Zeen Song, Jianqi Zhang, Changwen Zheng, Wenwen Qiang
However, our experiments reveal an unexpected result: there is negative knowledge transfer between tasks, affecting generalization performance.