← all projects

Toolrecover

Reward and preference experiments

Controlled experiments in tool recovery, policy optimization, and preferences.

Python · PyTorch · DPO

notes from the build

  • Recovery simulator, private state verifier, supervised baseline, grouped policy updates, DPO, and reward-model training.
  • Local runs did not establish an RL improvement. Human-data and AI-judge GPU studies remain pending.