no code implementations • 26 Mar 2024 • Akshay Paruchuri, Samuel Ehrenstein, Shuxian Wang, Inbar Fried, Stephen M. Pizer, Marc Niethammer, Roni Sengupta
Monocular depth estimation in endoscopy videos can enable assistive and robotic surgery to obtain better coverage of the organ and detection of various health issues.
no code implementations • 22 Mar 2024 • Jiaye Wu, Saeed Hadadan, Geng Lin, Matthias Zwicker, David Jacobs, Roni Sengupta
In this paper, we present GaNI, a Global and Near-field Illumination-aware neural inverse rendering technique that can reconstruct geometry, albedo, and roughness parameters from images of a scene captured with co-located light and camera.
no code implementations • 15 Nov 2023 • Jun Myeong Choi, Max Christman, Roni Sengupta
In this paper, we develop a personalized video relighting algorithm that produces high-quality and temporally consistent relit videos under any pose, expression, and lighting condition in real-time.
no code implementations • 31 Oct 2023 • Mykhailo Shvets, Dongxu Zhao, Marc Niethammer, Roni Sengupta, Alexander C. Berg
Multi-task approaches to joint depth and segmentation prediction are well-studied for monocular images.
no code implementations • 11 Jul 2023 • Luchao Qi, Jiaye Wu, Annie N. Wang, Shengze Wang, Roni Sengupta
Another challenge of personalization is the limited number of training images available for each individual, which often leads to overfitting when using full fine-tuning methods.