Skip to content
Hanqing Lu

Recursive self-improvement · Autonomous research

Hanqing (Henry) Lu

Founder & Research Lead, A-EVO Lab at Amazon

I study how AI can improve AI—from evolving agent harnesses to building autonomous research systems, evaluating their discoveries, and training models for research.

I lead A-EVO Lab at Amazon and co-lead OpenRSI Index. Previously, I worked at Microsoft Research and studied machine learning at Carnegie Mellon University (CMU).

Hanqing (Henry) Lu
A-EVO Lab

A research lab at Amazon focused on recursive self-improvement.

Explore the lab ↗

Research

Research agenda & selected papers
01

RSI-Training

Training models for autonomous research.

Held-out Qwen3 research: average experimental gains of 3.53 for the base 27B proposer, 20.19 for GPT-6-sol, 21.63 for GPT-6-sol with experimental records, and 53.72 for LM2LM
LM2LM · improving unseen Qwen3 models

arXiv · OCTOBER 2026

Qwen learns to improve Qwen—and outperforms GPT-6-sol.

Language Models Learn to Improve Language Models · LM2LM

Minhua Lin, Zijun Wang, Zewen Liu, …, Hanqing Lu

A 27B research model trained with RL achieves higher average experimental gains on a held-out Qwen3 family than GPT-6-sol—even with 300 experimental records in context. Research World Model rewards make training scalable, while real experiments keep the feedback grounded.

Held-out Qwen3 · Avg@4 gain: 53.72 vs. 21.63 for GPT-6-sol + ICL (10⁻³ BPB)

Research World Model predicts intervention gains from experimental records and selects promising experiments for execution
Research World Models · experiment selection

arXiv · OCTOBER 2026

Language Models as AI Research World Models

Zijun Wang, Zewen Liu, …, Hanqing Lu

AI agents can propose experiments faster than we can afford to run them. Research World Models use real experimental experience to predict an intervention’s gain before execution, directing limited compute toward the most promising experiments.

Beyond experiment selection, this predictive capability supplies rewards for Autoresearch model training in LM2LM, providing outcome-based feedback without executing every proposed experiment.

Real experimentation: 170,000+ H100 GPU-hours · 2,653 records · 9 research environments

02

RSI-Harness

Learning from experience through persistent improvements to skills, memory, prompts, and workflows.

A-Evolve architecture and evolution-loop workflow
A-Evolve · system architecture

OPEN-SOURCE FRAMEWORK

A-Evolve

A shared framework for building evolvers that turn agent experience into durable improvements. The foundation for our work on online and adaptive harness learning.

03

Autoresearch Harness

Systems that organize and execute the research process: hypotheses, experiments, evaluation, and revision.

04

RSI-Evaluation

Evaluating autonomous research against real model-development problems and human baselines.

OpenRSI's RSI-Anything task-contribution pipeline
RSI-Anything · task-building workflow

BENCHMARK · PROJECT CO-LEAD

OpenRSI Index

An open benchmark for AI research agents, built around auditable tasks and fixed verifiers.

My contribution: co-led and advise the project.

Marin-Scaling-Ladder · Qwen-122B-RL-Merge · GPIC

05

Agents & Reinforcement Learning

Selected work on agent training, tool-use evaluation, and value-guided decoding.