no code implementations • 4 Sep 2023 • Gabriel Sarch, Hsiao-Yu Fish Tung, Aria Wang, Jacob Prince, Michael Tarr
Deep neural network representations align well with brain activity in the ventral visual stream.
3 code implementations • 15 Jun 2021 • Daniel M. Bear, Elias Wang, Damian Mrowca, Felix J. Binder, Hsiao-Yu Fish Tung, R. T. Pramod, Cameron Holdaway, Sirui Tao, Kevin Smith, Fan-Yun Sun, Li Fei-Fei, Nancy Kanwisher, Joshua B. Tenenbaum, Daniel L. K. Yamins, Judith E. Fan
While current vision algorithms excel at many challenging tasks, it is unclear how well they understand the physical dynamics of real-world environments.
no code implementations • 12 Nov 2020 • Hsiao-Yu Fish Tung, Zhou Xian, Mihir Prabhudesai, Shamit Lal, Katerina Fragkiadaki
Object motion predictions are computed by a graph neural network that operates over the object features extracted from the 3D neural scene representation.
no code implementations • 30 Oct 2020 • Mihir Prabhudesai, Shamit Lal, Hsiao-Yu Fish Tung, Adam W. Harley, Shubhankar Potdar, Katerina Fragkiadaki
We can compare the 3D feature maps of two objects by searching alignment across scales and 3D rotations, and, as a result of the operation, we can estimate pose and scale changes without the need for 3D pose annotations.
1 code implementation • CVPR 2020 • Mihir Prabhudesai, Hsiao-Yu Fish Tung, Syed Ashar Javed, Maximilian Sieb, Adam W. Harley, Katerina Fragkiadaki
We propose associating language utterances to 3D visual abstractions of the scene they describe.
1 code implementation • ICLR 2020 • Adam W. Harley, Shrinidhi K. Lakshmikanth, Fangyu Li, Xian Zhou, Hsiao-Yu Fish Tung, Katerina Fragkiadaki
Predictive coding theories suggest that the brain learns by predicting observations at various levels of abstraction.
no code implementations • CVPR 2019 • Hsiao-Yu Fish Tung, Ricson Cheng, Katerina Fragkiadaki
The proposed networks learn to "lift" and integrate 2D visual features over time into latent 3D feature maps of the scene.
no code implementations • CVPR 2018 • Hsiao-Yu Fish Tung, Adam W. Harley, Liang-Kang Huang, Katerina Fragkiadaki
Humans effortlessly "program" one another by communicating goals and desires in natural language.
1 code implementation • NeurIPS 2017 • Hsiao-Yu Fish Tung, Hsiao-Wei Tung, Ersin Yumer, Katerina Fragkiadaki
In this work, we propose a learning based motion capture model for single camera input.
Ranked #2 on 3D Human Reconstruction on Surreal
no code implementations • ICCV 2017 • Hsiao-Yu Fish Tung, Adam W. Harley, William Seto, Katerina Fragkiadaki
Researchers have developed excellent feed-forward models that learn to map images to desired outputs, such as to the images' latent factors, or to other images, using supervised learning.
no code implementations • 31 Mar 2017 • Hsiao-Yu Fish Tung, Chao-yuan Wu, Manzil Zaheer, Alexander J. Smola
Nonparametric models are versatile, albeit computationally expensive, tool for modeling mixture models.