no code implementations • ACL 2022 • Alex Murphy, Bernd Bohnet, Ryan Mcdonald, Uta Noppeney
This work explores techniques to predict Part-of-Speech (PoS) tags from neural signals measured at millisecond resolution with electroencephalography (EEG) during text reading.
no code implementations • 28 May 2024 • Abrar Fahim, Alex Murphy, Alona Fyshe
We present evidence that attributes this contrastive gap to low uniformity in CLIP space, resulting in embeddings that occupy only a small portion of the latent space.
no code implementations • 27 May 2024 • Cory Efird, Alex Murphy, Joel Zylberberg, Alona Fyshe
Thus, our contrastive-learning methodology better characterizes new and existing visuo-semantic representations in the brain by leveraging multimodal neural network representations and a novel adaptation of clustering algorithms.
1 code implementation • 2 May 2024 • Alex Murphy, Joel Zylberberg, Alona Fyshe
Using fMRI and MEG data from the THINGS project, we show that if biased CKA is applied to representations of different sizes in the low-data high-dimensionality domain, they are not directly comparable due to biased CKA's sensitivity to differing feature-sample ratios and not stimuli-driven responses.
no code implementations • 6 Jun 2023 • Cory Efird, Alex Murphy, Joel Zylberberg, Alona Fyshe
In the final section of our analysis, we localize shared decodable concepts in the brain using a voxel-masking optimization method to produce a shared decodable concept (SDC) space.