no code implementations • 13 Jan 2024 • Joseph Pemberton, Rui Ponte Costa
Inspired by the accumulate $\mathrm{TD}(\lambda)$ in RL, we propose a fully online method for learning synthetic gradients which avoids the use of BPTT altogether: accumulate $BP(\lambda)$.
1 code implementation • 23 Jun 2022 • Will Greedy, Heng Wei Zhu, Joseph Pemberton, Jack Mellor, Rui Ponte Costa
First, we demonstrate that our model can effectively backpropagate errors through multiple layers using a single-phase learning process.
no code implementations • 5 Apr 2022 • Milton L. Montero, Jeffrey S. Bowers, Rui Ponte Costa, Casimir J. H. Ludwig, Gaurav Malhotra
Recent research has shown that generative models with highly disentangled representations fail to generalise to unseen combination of generative factor values.
1 code implementation • NeurIPS 2021 • Joseph Pemberton, Ellen Boven, Richard Apps, Rui Ponte Costa
Recently, decoupled neural interfaces (DNIs) were introduced as a solution to the forward and feedback locking problems in deep networks.
no code implementations • 21 Sep 2021 • Emma L. Roscow, Raymond Chua, Rui Ponte Costa, Matt W. Jones, Nathan Lepora
Learning to act in an environment to maximise rewards is among the brain's key functions.
no code implementations • 12 May 2021 • Luke Y. Prince, Roy Henha Eyono, Ellen Boven, Arna Ghosh, Joe Pemberton, Franz Scherr, Claudia Clopath, Rui Ponte Costa, Wolfgang Maass, Blake A. Richards, Cristina Savin, Katharina Anna Wilmes
We provide a brief review of the common assumptions about biological learning with findings from experimental neuroscience and contrast them with the efficiency of gradient-based learning in recurrent neural networks.
no code implementations • 1 Jan 2021 • Joseph Pemberton, Ellen Boven, Richard Apps, Rui Ponte Costa
Deep learning methods suffer from similar locking constraints both on the forward and backward phase.
1 code implementation • ICLR 2021 • Milton Llera Montero, Casimir JH Ludwig, Rui Ponte Costa, Gaurav Malhotra, Jeffrey Bowers
It is claimed that such representations should be able to capture the compositional structure of the world which can then be combined to produce novel representations.
no code implementations • 25 Sep 2019 • Samia Mohinta, Rui Ponte Costa, Stephane Ciocchi
The hippocampus has long been associated with spatial memory and goal-directed spatial navigation.
no code implementations • NeurIPS 2018 • João Sacramento, Rui Ponte Costa, Yoshua Bengio, Walter Senn
Deep learning has seen remarkable developments over the last years, many of them inspired by neuroscience.
no code implementations • 30 Dec 2017 • João Sacramento, Rui Ponte Costa, Yoshua Bengio, Walter Senn
Animal behaviour depends on learning to associate sensory stimuli with the desired motor command.
no code implementations • NeurIPS 2017 • Rui Ponte Costa, Yannis M. Assael, Brendan Shillingford, Nando de Freitas, Tim P. Vogels
Cortical circuits exhibit intricate recurrent architectures that are remarkably similar across different brain areas.