← Front page

Latent Space · Monday, October 26, 2026

LeashBio to Release Preprints, Datasets, and Harbor Packages for AI Chemistry Evals

Alongside the podcast release, LeashBio is publishing a preprint paper, a dataset, and harbor packages containing thousands of transcripts from their AI model evaluations. This release aims to let the community analyze the failure modes and decision-making processes of different language models.

personIan QuigleycompanyLeashBio

The tape

2 quotes
“Yeah, so the preprint will probably be out at the same time that this episode comes out. It is pretty ready. And what we show in there is that we get separation of agents across model families and that kind of stuff.”
Ian Quigley
“And so when the paper comes out, we're going to release a bunch of these environments as harbor packages and then many thousands of transcripts to go play with and see how these are being, you know, how their how their size.”
Ian Quigley
Heard on Latent Space — “⚡ An Eval for AI Scientists That Knows the Answer Key - Ian Quigley, Leash Bio”, published Monday, October 26, 2026. Heardvine summarizes and quotes with attribution and timestamps, and links to the original everywhere.
Transcribed via deepinfra · $0.00
LeashBio to Release Preprints, Datasets, and Harbor Packages for AI Chemistry Evals — Heardvine