1 code implementation • 30 Apr 2024 • Yuliang Liu, Mingxin Huang, Hao Yan, Linger Deng, Weijia Wu, Hao Lu, Chunhua Shen, Lianwen Jin, Xiang Bai
Typically, we propose a Prompt Queries Generation Module and a Tasks-aware Adapter to effectively convert the original single-task model into a multi-task model suitable for both image and video scenarios with minimal additional parameters.
2 code implementations • 11 Apr 2024 • Weiyu Sun, Xinyu Zhang, Hao Lu, Ying Chen, Yun Ge, Xiaolin Huang, Jie Yuan, Yingcong Chen
Remote photoplethysmography (rPPG) technology has become increasingly popular due to its non-invasive monitoring of various physiological indicators, making it widely applicable in multimedia interaction, healthcare, and emotion analysis.
2 code implementations • 10 Apr 2024 • Hao Lu, Jiaqi Tang, Xinli Xu, Xu Cao, Yunpeng Zhang, Guoqing Wang, Dalong Du, Hao Chen, Yingcong Chen
Finally, for MC3D-Det joint training, the elaborate dataset merge strategy is designed to solve the problem of inconsistent camera numbers and camera parameters.
1 code implementation • 23 Mar 2024 • He guo, Zixuan Ye, Zhiguo Cao, Hao Lu
We introduce in-context matting, a novel task setting of image matting.
1 code implementation • 11 Mar 2024 • Yuting Zhang, Hao Lu, Xin Liu, Yingcong Chen, Kaishun Wu
Remote photoplethysmography (rPPG) is a promising technology that captures physiological signals from face videos, with potential applications in medical health, emotional computing, and biosecurity recognition.
2 code implementations • 9 Mar 2024 • Hao Lu, Xuesong Niu, Jiyao Wang, Yin Wang, Qingyong Hu, Jiaqi Tang, Yuting Zhang, Kaishen Yuan, Bin Huang, Zitong Yu, Dengbo He, Shuiguang Deng, Hao Chen, Yingcong Chen, Shiguang Shan
In conclusion, this paper provides valuable insights into the potential applications and challenges of MLLMs in human-centric computing.
no code implementations • 16 Jan 2024 • Mostafa Rezapour, Muhammad Khalid Khan Niazi, Hao Lu, Aarthi Narayanan, Metin Nafi Gurcan
This study introduces the Supervised Magnitude-Altitude Scoring (SMAS) methodology, a machine learning-based approach, for analyzing gene expression data obtained from nonhuman primates (NHPs) infected with Ebola virus (EBOV).
1 code implementation • 23 Dec 2023 • Gen Shi, Hao Lu, Hui Hui, Jie Tian
In this study, we construct the largest preprocessed unlabeled TOF-MRA datasets (1510 subjects) to date.
1 code implementation • 14 Dec 2023 • Jiaqi Tang, Hao Lu, Xiaogang Xu, Ruizheng Wu, Sixing Hu, Tong Zhang, Tsz Wa Cheng, Ming Ge, Ying-Cong Chen, Fugee Tsung
Artificial Intelligence (AI)-driven defect inspection is pivotal in industrial manufacturing.
no code implementations • 14 Nov 2023 • Ying Li, Zhencai Zhu, Xiaoqiang Li, Chunyu Yang, Hao Lu
In this paper, we present how to apply RL to the autonomous control of mining electric locomotives.
no code implementations • 9 Nov 2023 • Xinyu Zhang, Weiyu Sun, Hao Lu, Ying Chen, Yun Ge, Xiaolin Huang, Jie Yuan, Yingcong Chen
In this paper, we propose a Self-Similarity Prior Distillation (SSPD) framework for unsupervised rPPG estimation, which capitalizes on the intrinsic self-similarity of cardiac activities.
1 code implementation • 17 Oct 2023 • Hao Lu, Yunpeng Zhang, Qing Lian, Dalong Du, Yingcong Chen
In our approach, we render diverse view maps from BEV features and rectify the perspective bias of these maps, leveraging implicit foreground volumes to bridge the camera and BEV planes.
1 code implementation • ICCV 2023 • Wenze Liu, Hao Lu, Hongtao Fu, Zhiguo Cao
We present DySample, an ultra-lightweight and effective dynamic upsampler.
1 code implementation • ICCV 2023 • Chengxin Liu, Hao Lu, Zhiguo Cao, Tongliang Liu
Such a querying process yields an intuitive, universal modeling of crowd as both the input and output are interpretable and steerable.
3 code implementations • ICCV 2023 • Mingxin Huang, Jiaxin Zhang, Dezhi Peng, Hao Lu, Can Huang, Yuliang Liu, Xiang Bai, Lianwen Jin
To this end, we introduce a new model named Explicit Synergy-based Text Spotting Transformer framework (ESTextSpotter), which achieves explicit synergy by modeling discriminative and interactive features for text detection and recognition within a single decoder.
no code implementations • 20 Aug 2023 • Hao Lu, Austin M. Bray, Chao Hu, Andrew T. Zimmerman, Hongyi Xu
During the model evaluation process, the proposed approach retrieves prediction basis samples from the health library according to the similarity of the feature importance.
1 code implementation • ICCV 2023 • Weiyue Zhao, Xin Li, Zhan Peng, Xianrui Luo, Xinyi Ye, Hao Lu, Zhiguo Cao
Video stabilization refers to the problem of transforming a shaky video into a visually pleasing one.
1 code implementation • 17 Jul 2023 • Wenze Liu, Hao Lu, Yuliang Liu, Zhiguo Cao
In DAB-DETR, such queries are modulated by the so-called conditional linear projection at each decoder stage, aiming to search for positions of interest such as the four extremities of the box.
2 code implementations • 17 Jul 2023 • Wenze Liu, Hao Lu, Yuliang Liu, Zhiguo Cao
We introduce the notion of point affiliation into feature upsampling.
no code implementations • 7 Jun 2023 • Weiyue Zhao, Hao Lu, Xinyi Ye, Zhiguo Cao, Xin Li
We introduce Probabilistic Coordinate Fields (PCFs), a novel geometric-invariant coordinate representation for image correspondence problems.
no code implementations • 5 Jun 2023 • Weiyue Zhao, Hao Lu, Zhiguo Cao, Xin Li
This approach offers a new perspective to alleviate the problem of repeated patterns and emphasizes the importance of choosing coordinate representations for feature correspondences.
1 code implementation • 4 Jun 2023 • Xin Liu, Yuting Zhang, Zitong Yu, Hao Lu, Huanjing Yue, Jingyu Yang
However, they focus on the contrastive learning between samples, which neglect the inherent self-similar prior in physiological signals and seem to have a limited ability to cope with noisy.
1 code implementation • 8 May 2023 • Zhicheng Wang, Liwen Xiao, Zhiguo Cao, Hao Lu
This task is typically addressed by extracting the features of query image and exemplars respectively and then matching their feature similarity, leading to an extract-then-match paradigm.
Ranked #2 on Object Counting on FSC147
1 code implementation • 26 Apr 2023 • Hao Lu, Adam Thelen, Olga Fink, Chao Hu, Simon Laflamme
To quantify dataset similarity between clients without explicitly sharing data, each client sets aside a local test dataset and evaluates the other clients' model prediction accuracy and uncertainty on this test dataset.
no code implementations • 11 Apr 2023 • Xianrui Luo, Juewen Peng, Weiyue Zhao, Ke Xian, Hao Lu, Zhiguo Cao
Benefiting from the multi-camera module in modern smartphones, we introduce a new task of AIF synthesis from main (wide) and ultra-wide cameras.
no code implementations • 28 Mar 2023 • Xinyi Ye, Weiyue Zhao, Hao Lu, Zhiguo Cao
It is challenging because of the disorganized spatial distribution of numerous outliers, especially when putative correspondences are largely dominated by outliers.
no code implementations • 19 Mar 2023 • Yixun Liang, Hao He, Shishi Xiao, Hao Lu, Yingcong Chen
In this paper, we propose a principled approach that supports learning from heterogeneous datasets with different label sets.
1 code implementation • CVPR 2023 • Hao Lu, Zitong Yu, Xuesong Niu, Yingcong Chen
We show that most domain generalization methods do not work well in this problem, as domain labels are ambiguous in complicated environmental changes.
no code implementations • 17 Feb 2023 • Zhiyu Pan, Yinpeng Chen, Jiale Zhang, Hao Lu, Zhiguo Cao, Weicai Zhong
Observing that similar composition patterns tend to be shared by the cropping boundaries annotated nearly, we argue to find the beauty of composition from the rare samples by clustering the samples with similar cropping boundary annotations, ie, similar composition patterns.
1 code implementation • 27 Dec 2022 • Zixuan Ye, Yutong Dai, Chaoyi Hong, Zhiguo Cao, Hao Lu
Inspired by this, we introduce a novel composition style that binds the source and combined foregrounds in a definite triplet.
no code implementations • 20 Dec 2022 • Fei Wu, Luoyu Chen, Hao Lu
Level 5 Autonomous Driving, a technology that a fully automated vehicle (AV) requires no human intervention, has raised serious concerns on safety and stability before widespread use.
2 code implementations • 26 Sep 2022 • Hao Lu, Wenze Liu, Zixuan Ye, Hongtao Fu, Yuliang Liu, Zhiguo Cao
We introduce point affiliation into feature upsampling, a notion that describes the affiliation of each upsampled point to a semantic cluster formed by local decoder feature points with semantic similarity.
Ranked #5 on Feature Upsampling on ImageNet
1 code implementation • 1 Aug 2022 • Zijin Wu, Xingyi Li, Juewen Peng, Hao Lu, Zhiguo Cao, Weicai Zhong
To mitigate this issue, we introduce DoF-NeRF, a novel neural rendering approach that can deal with shallow DoF inputs and can simulate DoF effect.
1 code implementation • 31 Jul 2022 • Yinpeng Chen, Zhiyu Pan, Min Shi, Hao Lu, Zhiguo Cao, Weicai Zhong
Generative adversarial networks (GANs) have been trained to be professional artists able to create stunning artworks such as face generation and image style transfer.
no code implementations • 21 Jul 2022 • Hao Lu, Wenze Liu, Hongtao Fu, Zhiguo Cao
We consider the problem of task-agnostic feature upsampling in dense prediction where an upsampling operator is required to facilitate both region-sensitive tasks like semantic segmentation and detail-sensitive tasks such as image matting.
1 code implementation • 20 Jul 2022 • Chengxin Liu, Kewei Wang, Hao Lu, Zhiguo Cao, Ziming Zhang
As the crowd-sourcing labeling process and the ambiguities of the objects may raise noisy bounding box annotations, the object detectors will suffer from the degenerated training data.
1 code implementation • 18 Jul 2022 • Juewen Peng, Jianming Zhang, Xianrui Luo, Hao Lu, Ke Xian, Zhiguo Cao
Partial occlusion effects are a phenomenon that blurry objects near a camera are semi-transparent, resulting in partial appearance of occluded background.
1 code implementation • 15 Jul 2022 • Yizheng Wu, Min Shi, Shuaiyuan Du, Hao Lu, Zhiguo Cao, Weicai Zhong
The idea of instance kernel is inspired by recent success of dynamic convolutions in 2D/3D instance segmentation.
Ranked #2 on 3D Instance Segmentation on S3DIS (mCov metric)
1 code implementation • CVPR 2022 • Juewen Peng, Zhiguo Cao, Xianrui Luo, Hao Lu, Ke Xian, Jianming Zhang
Based on this formulation, we implement the classical renderer by a scattering-based method and propose a two-stage neural renderer to fix the erroneous areas from the classical renderer.
1 code implementation • CVPR 2022 • Min Shi, Hao Lu, Chen Feng, Chengxin Liu, Zhiguo Cao
In this work, we propose a similarity-aware CAC framework that jointly learns representation and similarity metric.
Ranked #4 on Object Counting on CARPK
1 code implementation • CVPR 2021 • Chaoyi Hong, Shuaiyuan Du, Ke Xian, Hao Lu, Zhiguo Cao, Weicai Zhong
To this end, we introduce the concept of the key composition map (KCM) to encode the composition rules.
Ranked #1 on Image Cropping on FLMS
no code implementations • CVPR 2021 • Hao Lu, Hu Han, S. Kevin Zhou
Remote photoplethysmography (rPPG) based physiological measurement has great application values in health monitoring, emotion analysis, etc.
no code implementations • 6 Feb 2021 • Botao Hao, Xiang Ji, Yaqi Duan, Hao Lu, Csaba Szepesvári, Mengdi Wang
Bootstrapping provides a flexible and effective approach for assessing the quality of batch reinforcement learning, yet its theoretical property is less understood.
no code implementations • ICCV 2021 • Zhiyu Pan, Zhiguo Cao, Kewei Wang, Hao Lu, Weicai Zhong
We show that relation modeling between visual elements matters in cropping view recommendation.
1 code implementation • CVPR 2021 • Yutong Dai, Hao Lu, Chunhua Shen
By looking at existing upsampling operators from a unified mathematical perspective, we generalize them into a second-order form and introduce Affinity-Aware Upsampling (A2U) where upsampling kernels are generated using a light-weight lowrank bilinear model and are conditioned on second-order features.
no code implementations • 23 Aug 2020 • Hao Lu, Quanming Xu, Chaohong Wang, Jianyang Wu, Rongdun Hong, Xiang-Yang Liu, Zhisen Zhang
Heterogeneous ice nucleation is one of the most common and important process in the physical environment.
Materials Science
1 code implementation • ECCV 2020 • Liang Liu, Hao Lu, Hongwei Zou, Haipeng Xiong, Zhiguo Cao, Chunhua Shen
Inspired by scale weighing, we propose a novel 'counting scale' termed LibraNet where the count value is analogized by weight.
1 code implementation • ICLR 2020 • Hao Lu, Xingwen Zhang, Shuang Yang
This paper is concerned with solving combinatorial optimization problems, in particular, the capacitated vehicle routing problems (CVRP).
no code implementations • 26 Mar 2020 • Xiaobai Li, Hu Han, Hao Lu, Xuesong Niu, Zitong Yu, Antitza Dantcheva, Guoying Zhao, Shiguang Shan
Remote measurement of physiological signals from videos is an emerging topic.
3 code implementations • 7 Jan 2020 • Haipeng Xiong, Hao Lu, Chengxin Liu, Liang Liu, Chunhua Shen, Zhiguo Cao
Visual counting, a task that aims to estimate the number of objects from an image/video, is an open-set problem by nature, i. e., the number of population can vary in [0, inf) in theory.
5 code implementations • ICCV 2019 • Haipeng Xiong, Hao Lu, Chengxin Liu, Liang Liu, Zhiguo Cao, Chunhua Shen
A dense region can always be divided until sub-region counts are within the previously observed closed set.
Ranked #3 on Crowd Counting on TRANCOS
6 code implementations • 11 Aug 2019 • Hao Lu, Yutong Dai, Chunhua Shen, Songcen Xu
By viewing the indices as a function of the feature map, we introduce the concept of "learning to index", and present a novel index-guided encoder-decoder framework where indices are self-learned adaptively from data and are used to guide the downsampling and upsampling stages, without extra training supervision.
Ranked #2 on Grayscale Image Denoising on Set12 sigma30
1 code implementation • ICCV 2019 • Hao Lu, Yutong Dai, Chunhua Shen, Songcen Xu
We show that existing upsampling operators can be unified with the notion of the index function.
no code implementations • 24 May 2019 • Hao Lu, Mengdi Wang
Joint replacement is the most common inpatient surgical treatment in the US.
no code implementations • EMNLP 2018 • Hong Chen, Zhenhua Fan, Hao Lu, Alan L. Yuille, Shu Rong
We introduce PreCo, a large-scale English dataset for coreference resolution.
1 code implementation • 11 Jul 2018 • Ruibo Li, Ke Xian, Chunhua Shen, Zhiguo Cao, Hao Lu, Lingxiao Hang
However, robust depth prediction suffers from two challenging problems: a) How to extract more discriminative features for different scenes (compared to a single scene)?
no code implementations • ICML 2018 • Hao Lu, Yuan Cao, Zhuoran Yang, Junwei Lu, Han Liu, Zhaoran Wang
We study the hypothesis testing problem of inferring the existence of combinatorial structures in undirected graphical models.
no code implementations • CVPR 2018 • Ke Xian, Chunhua Shen, Zhiguo Cao, Hao Lu, Yang Xiao, Ruibo Li, Zhenbo Luo
In this paper we study the problem of monocular relative depth perception in the wild.
1 code implementation • ICCV 2017 • Hao Lu, Lei Zhang, Zhiguo Cao, Wei Wei, Ke Xian, Chunhua Shen, Anton Van Den Hengel
Domain adaption (DA) allows machine learning methods trained on data sampled from one distribution to be applied to data sampled from another.
no code implementations • 7 Jul 2017 • Hao Lu, Zhiguo Cao, Yang Xiao, Bohan Zhuang, Chunhua Shen
To our knowledge, this is the first time that a plant-related counting problem is considered using computer vision technologies under unconstrained field-based environment.