
A known enzyme had overlooked clues next to it
DNA databases contain genes whose existence is recorded but whose functions remain poorly understood. Scientists compare them with known proteins and examine neighboring genes for clues to unfamiliar systems. Reading a large collection and identifying a difference worth testing are separate achievements.
Anthropic’s September 23 report makes that distinction concrete. The reverse transcriptase, an enzyme that copies RNA into DNA, that attracted Claude’s attention was already known. The newly recognized features involved nearby DNA repeats and an accessory protein forming an associated system. Anthropic calls it ART and continues to investigate its function.
For research adoption, asking whether AI has become a scientist is insufficient. When AI widens the candidate search, how efficiently does it narrow the results into hypotheses people can test? This article compares sequence search, literature-based hypothesis generation, instrument-connected experiments, and research evaluation. Our judgment is that the handoff into verification should be measured as part of the research outcome.
What the ART search automated, and what remains unresolved
Anthropic reports that Claude collected more than 200,000 reverse transcriptases, selected 3,500 candidate systems, and analyzed 20 in detail. Approximately 950 agents spent 21 hours and 210 million tokens on the search. These are company-reported figures, not counts of experimentally confirmed candidates.
Initial ART experiments showed that the repeat array produces short RNAs. The company also states that the primary function remains unknown and that human scientists perform all laboratory work. An observation that repeats resemble CRISPR cannot be treated as a completed gene-editing technology.
That distinction does not diminish the contribution of identifying an overlooked system. Exploring the neighborhood of a known enzyme can change what scientists investigate. But the report they receive must distinguish established facts, newly observed relationships, proposed functions, and unresolved questions. Persuasiveness alone does not tell them which experiment to choose.
Co-Scientist compares hypotheses before experimental selection
Where the ART search identifies unusual combinations in sequence data, Google’s Co-Scientist paper describes generating hypotheses from research objectives and existing literature, then repeatedly critiquing, ranking, and refining them. Scientists provide objectives and constraints and can redirect the work. Comparisons between agents are a selection stage before experiments.
The paper examines drug repurposing, novel treatment targets, and mechanisms of antimicrobial resistance. It reports in vitro validation of drug candidates and combinations for acute myeloid leukemia. These cases cross from judging a written hypothesis into checking it against external observations. Results in cells do not establish clinical effectiveness in people.
Both approaches separate candidate creation from the work that adds evidence for adoption. Their entry points differ: relationships in sequence data versus hypotheses connecting existing knowledge. A research institution’s choice should depend on whether its clues sit in insufficiently explored data or whether it needs explanations and experimental proposals spanning the literature.
Co-Scientist’s authors identify missing access to paywalled literature and negative results, source quality, hallucinations, and preliminary validation as limitations. A high internal ranking can incorporate gaps in the material searched. Our interpretation is that rankings should travel with a record of both their supporting material and important material that was unavailable.
Instrument-connected autonomy and computational autonomy differ
Obtaining external observations requires translating a hypothesis into experimental work. Coscientist research demonstrated tasks involving chemical information, hardware documentation, cloud laboratories, and liquid-handling instruments. ChemCrow connected chemistry tools to an LLM and examined tasks including synthesis with expert evaluation. Instruments and specialized tools connect language generation to externally testable actions.
A computational environment can let the same agent take responsibility for more of the experiment. The AI Scientist-v2 connects hypotheses, computational experiments, analysis, and manuscript generation. Its authors report submitting three manuscripts to an ICLR workshop, with one exceeding the acceptance threshold. This demonstrates an integrated computational research process; it does not establish automation of all laboratory work or biological validation.
ART search
Select candidates and relationships in sequences. External checks concern associated-system features and biological function.
Co-Scientist
Generate and compare literature-based hypotheses. Check experimental results and reproducibility externally.
Chemistry tools and instruments
Connect investigation to protocols and operations. Verify actual reactions and measurements.
AI Scientist-v2
Connect computational experiments and writing. Check execution results, research validity, and peer review.
This is not a performance ranking. Equipment, samples, data, and assessment methods differ, so systems described as autonomous take responsibility for different work. Adoption requires mapping what AI can operate and what the responsible scientist must verify onto the institution’s own process.
Measure knowledge, executed analysis, and discovery separately
The differences also appear in evaluation. LAB-Bench uses multiple-choice questions to assess biology research skills involving literature, figures, databases, and sequences. BixBench tests analysis of biological data and interpretation through open answers. Answering the former correctly and completing the latter’s analysis are different outcomes.
ScienceAgentBench extracts 102 tasks from 44 peer-reviewed papers and assesses programs, execution results, and costs. PaperBench evaluates replication of existing AI research through code development and experimental execution, using rubrics developed with original authors. Both provide ways to assess completion beyond a plausible explanation.
These evaluations neither disprove the ART finding nor reduce current model capability to one score. Their models, attempts, tools, and disciplines differ. The transferable idea is to distinguish answering a knowledge question, executing analysis, reproducing an established result, and validating a new hypothesis.
Giving a candidate-search agent established results to reproduce can check whether its methods meet basic conditions. That still does not establish that a new candidate is correct. Recording method checks and hypothesis checks separately makes failures easier to investigate.
Count experimental and review work when expanding the search
To evaluate adoption, compare the normal human procedure, existing search and analysis tools, and an AI-assisted procedure under the same data, research objective, time, and cost conditions. This is our proposed evaluation method, not an experiment this publication performed on ART or Co-Scientist. For some tasks, a fixed analysis program is a cheaper and more traceable baseline.
Record candidates, duplicates, previously known findings, rejection reasons, and candidates advanced to experiments. More candidates do not accelerate the whole process if they expand the expert-review queue or the laboratory backlog. Conversely, narrowing a search to useful candidates without more experiments can have value even with a smaller output count.
Time should include source checking, protocol corrections, experimental waiting, and repeated experiments. Cost should include expert review and laboratory materials as well as inference and computation. The reported 21 hours and token count describe the search’s scale; they do not determine the return on the entire research process.
For tested candidates, retain results that support the initial hypothesis and results that require another explanation. Without negative findings and revised hypotheses feeding back into later searches, AI may repeatedly offer appealing proposals that people must reject again. We judge reusable rejection evidence to be part of making large-scale hypothesis generation useful.
Make discovery reports useful for choosing the next experiment
The ART search shows that scientists can receive unusual combinations as research targets without personally following every sequence. Co-Scientist offers another way to compare hypotheses connecting prior knowledge. In both cases, work that establishes research value continues after the AI finishes its report.
We favor starting with candidate search within one protein family or comparisons of explanations for a narrowly defined phenomenon. Clear inputs, established checks, experiments, and responsible reviewers let the same record show whether broader search outweighs additional verification work. Missing literature and unknown functions belong in that record.
Evaluating AI research as progress requires following generated hypotheses into observations that support, revise, or reject them, and identifying who performed those checks. ART’s continuing functional investigation illustrates that distinction. Connecting a discovery announcement to a report that helps choose the next experiment makes broad AI exploration usable within scientists’ limited time and equipment.