Search Results for author: Siyuan Guo

Found 15 papers, 6 papers with code

Do Finetti: On Causal Effects for Exchangeable Data

no code implementations29 May 2024 Siyuan Guo, Chi Zhang, Karthika Mohan, Ferenc Huszár, Bernhard Schölkopf

We study causal effect estimation in a setting where the data are not i. i. d.

Learning Beyond Pattern Matching? Assaying Mathematical Understanding in LLMs

no code implementations24 May 2024 Siyuan Guo, Aniket Didolkar, Nan Rosemary Ke, Anirudh Goyal, Ferenc Huszár, Bernhard Schölkopf

By contrast, certain instruction-tuning leads to similar performance changes irrespective of training on different data, suggesting a lack of domain understanding across different skills.

Metacognitive Capabilities of LLMs: An Exploration in Mathematical Problem Solving

no code implementations20 May 2024 Aniket Didolkar, Anirudh Goyal, Nan Rosemary Ke, Siyuan Guo, Michal Valko, Timothy Lillicrap, Danilo Rezende, Yoshua Bengio, Michael Mozer, Sanjeev Arora

(b) When using an LLM to solve the test questions, we present it with the full list of skill labels and ask it to identify the skill needed.

GSM8K Math

DS-Agent: Automated Data Science by Empowering Large Language Models with Case-Based Reasoning

1 code implementation27 Feb 2024 Siyuan Guo, Cheng Deng, Ying Wen, Hechang Chen, Yi Chang, Jun Wang

In this work, we investigate the potential of large language models (LLMs) based agents to automate data science tasks, with the goal of comprehending task requirements, then building and training the best-fit machine learning models.

Code Generation

CausalCite: A Causal Formulation of Paper Citations

1 code implementation5 Nov 2023 Ishan Kumar, Zhijing Jin, Ehsan Mokhtarian, Siyuan Guo, Yuen Chen, Mrinmaya Sachan, Bernhard Schölkopf

Thus, we propose CausalCite, a new way to measure the significance of a paper by assessing the causal impact of the paper on its follow-up papers.

Causal Inference counterfactual

Learning Generalizable Agents via Saliency-Guided Features Decorrelation

no code implementations NeurIPS 2023 Sili Huang, Yanchao Sun, Jifeng Hu, Siyuan Guo, Hechang Chen, Yi Chang, Lichao Sun, Bo Yang

Our experimental results demonstrate that SGFD can generalize well on a wide range of test environments and significantly outperforms state-of-the-art methods in handling both task-irrelevant variations and task-relevant variations.

Reinforcement Learning (RL)

Diffusing on Two Levels and Optimizing for Multiple Properties: A Novel Approach to Generating Molecules with Desirable Properties

no code implementations5 Oct 2023 Siyuan Guo, Jihong Guan, Shuigeng Zhou

Extensive experiments with two benchmark datasets QM9 and ZINC250k show that the molecules generated by our proposed method have better validity, uniqueness, novelty, Fr\'echet ChemNet Distance (FCD), QED, and PlogP than those generated by current SOTA models.

Out-of-Variable Generalization for Discriminative Models

no code implementations16 Apr 2023 Siyuan Guo, Jonas Wildberger, Bernhard Schölkopf

The ability of an agent to do well in new environments is a critical aspect of intelligence.

Out-of-Distribution Generalization

Dataflow graphs as complete causal graphs

1 code implementation16 Mar 2023 Andrei Paleyes, Siyuan Guo, Bernhard Schölkopf, Neil D. Lawrence

Component-based development is one of the core principles behind modern software engineering practices.

On the Interventional Kullback-Leibler Divergence

no code implementations10 Feb 2023 Jonas Wildberger, Siyuan Guo, Arnab Bhattacharyya, Bernhard Schölkopf

Modern machine learning approaches excel in static settings where a large amount of i. i. d.

Causal de Finetti: On the Identification of Invariant Causal Structure in Exchangeable Data

1 code implementation NeurIPS 2023 Siyuan Guo, Viktor Tóth, Bernhard Schölkopf, Ferenc Huszár

We then present our main identifiability theorem, which shows that given data from an ICM generative process, its unique causal structure can be identified through performing conditional independence tests.

Causal Inference

Enhanced Doubly Robust Learning for Debiasing Post-click Conversion Rate Estimation

1 code implementation28 May 2021 Siyuan Guo, Lixin Zou, Yiding Liu, Wenwen Ye, Suqi Cheng, Shuaiqiang Wang, Hechang Chen, Dawei Yin, Yi Chang

Based on it, a more robust doubly robust (MRDR) estimator has been proposed to further reduce its variance while retaining its double robustness.

counterfactual Imputation +2

Cannot find the paper you are looking for? You can Submit a new open access paper.