Verified Multi-Step Synthesis using Large Language Models and Monte Carlo Tree Search

1 code implementation • 13 Feb 2024 • David Brandfonbrener, Sibi Raja, Tarun Prasad, Chloe Loughridge, Jianang Yang, Simon Henniger, William E. Byrd, Robert Zinkov, Nada Amin

The base model with VMCTS is even competitive with ChatGPT4 augmented with plugins and multiple re-tries on these problems.

Opening the AI black box: program synthesis via mechanistic interpretability

1 code implementation • 7 Feb 2024 • Eric J. Michaud, Isaac Liao, Vedang Lad, Ziming Liu, Anish Mudide, Chloe Loughridge, Zifan Carl Guo, Tara Rezaei Kheirkhah, Mateja Vukelić, Max Tegmark

We present MIPS, a novel method for program synthesis based on automated mechanistic interpretability of neural networks trained to perform the desired task, auto-distilling the learned algorithm into Python code.

Program Synthesis Symbolic Regression