Search Results for author: Puning Zhao

Found 15 papers, 0 papers with code

Learning with User-Level Local Differential Privacy

no code implementations27 May 2024 Puning Zhao, Li Shen, Rongfei Fan, Qingming Li, Huiwen Wu, Jiafei Wu, Zhe Liu

Under the central model, user-level DP is strictly stronger than the item-level one.

Enhancing Learning with Label Differential Privacy by Vector Approximation

no code implementations24 May 2024 Puning Zhao, Rongfei Fan, Huiwen Wu, Qingming Li, Jiafei Wu, Zhe Liu

Label differential privacy (DP) is a framework that protects the privacy of labels in training datasets, while the feature vectors are public.

CG-FedLLM: How to Compress Gradients in Federated Fune-tuning for Large Language Models

no code implementations22 May 2024 Huiwen Wu, Xiaohan Li, Deyi Zhang, Xiaogang Xu, Jiafei Wu, Puning Zhao, Zhe Liu

The success of current Large-Language Models (LLMs) hinges on extensive training data that is collected and stored centrally, called Centralized Learning (CL).

Decoder Federated Learning

A Huber Loss Minimization Approach to Mean Estimation under User-level Differential Privacy

no code implementations22 May 2024 Puning Zhao, Lifeng Lai, Li Shen, Qingming Li, Jiafei Wu, Zhe Liu

We provide a theoretical analysis of our approach, which gives the noise strength needed for privacy protection, as well as the bound of mean squared error.

Emulating Full Client Participation: A Long-Term Client Selection Strategy for Federated Learning

no code implementations22 May 2024 Qingming Li, Juzheng Miao, Puning Zhao, Li Zhou, Shouling Ji, BoWen Zhou, Furui Liu

In this study, we propose a novel client selection strategy designed to emulate the performance achieved with full client participation.

Soft Label PU Learning

no code implementations3 May 2024 Puning Zhao, Jintao Deng, Xu Cheng

In this paper, we propose soft label PU learning, in which unlabeled data are assigned soft labels according to their probabilities of being positive.

Common Sense Reasoning

Minimax Optimal $Q$ Learning with Nearest Neighbors

no code implementations3 Aug 2023 Puning Zhao, Lifeng Lai

A modification of the original $Q$ learning method was proposed in (Shah and Xie, 2018), which estimates $Q$ values with nearest neighbors.

Q-Learning

High Dimensional Distributed Gradient Descent with Arbitrary Number of Byzantine Attackers

no code implementations25 Jul 2023 Puning Zhao, Zhiguo Wan

In this paper, we design a new method that is suitable for high dimensional problems, under arbitrary number of Byzantine attackers.

Robust Nonparametric Regression under Poisoning Attack

no code implementations26 May 2023 Puning Zhao, Zhiguo Wan

The final estimate is nearly minimax optimal for arbitrary $q$, up to a $\ln N$ factor.

regression

Optimal Stochastic Nonconvex Optimization with Bandit Feedback

no code implementations30 Mar 2021 Puning Zhao, Lifeng Lai

In this paper, we analyze the continuous armed bandit problems for nonconvex cost functions under certain smoothness and sublevel set assumptions.

Analysis of KNN Density Estimation

no code implementations30 Sep 2020 Puning Zhao, Lifeng Lai

We show that kNN density estimation is minimax optimal under both $\ell_1$ and $\ell_\infty$ criteria, if the support set is known.

Density Estimation

Minimax Optimal Estimation of KL Divergence for Continuous Distributions

no code implementations26 Feb 2020 Puning Zhao, Lifeng Lai

Estimating Kullback-Leibler divergence from identical and independently distributed samples is an important problem in various domains.

Minimax Rate Optimal Adaptive Nearest Neighbor Classification and Regression

no code implementations22 Oct 2019 Puning Zhao, Lifeng Lai

For both classification and regression problems, existing works have shown that, if the distribution of the feature vector has bounded support and the probability density function is bounded away from zero in its support, the convergence rate of the standard kNN method, in which k is the same for all test samples, is minimax optimal.

Classification General Classification +1

Analysis of KNN Information Estimators for Smooth Distributions

no code implementations27 Oct 2018 Puning Zhao, Lifeng Lai

Existing work has analyzed the convergence rate of this estimator for random variables whose densities are bounded away from zero in its support.

Cannot find the paper you are looking for? You can Submit a new open access paper.