no code implementations • 4 Aug 2021 • Aditya Desai, Li Chou, Anshumali Shrivastava
In this paper, we present Random Offset Block Embedding Array (ROBE) as a low memory alternative to embedding tables which provide orders of magnitude reduction in memory usage while maintaining accuracy and boosting execution speed.
1 code implementation • 24 Feb 2021 • Aditya Desai, Yanzhou Pan, Kuangyuan Sun, Li Chou, Anshumali Shrivastava
In particular, our LMA embeddings achieve the same performance compared to standard embeddings with a 16$\times$ reduction in memory footprint.
no code implementations • 23 Nov 2020 • Zichang Liu, Li Chou, Anshumali Shrivastava
In this paper, we argue that the state-of-the-art-systems are significantly worse in terms of accuracy because they are incapable of utilizing these essential structural information.