Researchers release SciWorkBench evaluating scientific agents

What happened.AI researchers from Alibaba Group and Tsinghua University introduced SciWorkBench, an evaluation suite assessing autonomous agents across complex multi-step workflows in biology, chemistry, materials science, and physics.
Why it matters.Standard academic benchmarks test static multiple-choice scientific recall rather than procedural laboratory execution. Exposing low agent completion rates on end-to-end scientific workflows highlights the necessity for specialized domain harnesses before deploying agents in production research environments.
The technical specifications:
- Cross-domain evaluation: Spans diverse experimental disciplines including molecular synthesis planning, chemical kinetics, and condensed matter physics.
- Performance baseline: Top frontier agent configurations achieved a mean score of 57.38 percent across end-to-end research trajectories.
- Failure modes: Identifies procedural translation errors, poor cross-modal evidence synthesis, and weak self-correction as primary bottlenecks.
- Execution harness: Standardizes real-world tool execution environments including Python computation engines and scientific database connectors.
STORYLINE PROGRESSION & CONTEXT
This report represents a verified evolution of prior newsroom intelligence: