Ai2 Open-Sources AstaBrief 8B: a Cited Research Report in 51 Seconds, 3.5x Faster Than Its Claude Pipeline

The Allen Institute for AI has released the weights behind the fastest path in its scientific research assistant. On October 2 the non-profit open-sourced AstaBrief 8B, an eight-billion-parameter model that turns a research question plus retrieved literature excerpts into a single, fully cited report — the model that powers "Fast mode" in Asta's Generate a report feature.

The headline number is speed. Across the full Asta pipeline, Ai2 reports an average of 51.1 seconds per report in Fast mode against 178.5 seconds for its Claude-powered Thinking mode, roughly 3.5 times faster, with generation time itself nearly an order of magnitude lower. The gain comes from architecture rather than only from a smaller model: AstaBrief writes the entire report in one pass, skipping the snippet summarisation, clustering and section-by-section drafting that the multi-step proprietary pipeline performs.

AstaBrief is built on Qwen3-8B and tuned with supervised fine-tuning plus direct preference optimisation rather than reinforcement learning. Ai2 started from 90,000 research-focused queries drawn from real Asta user logs — filtered to remove beta-tester and bot traffic, short and non-English prompts, non-scientific requests and anything containing personal information — then generated target reports with its multi-step ScholarQA pipeline using a mix of Claude 3.5 Sonnet, Claude 3.7 Sonnet, o3, o4-mini and GPT-4.1. After quality filtering, about 47,000 usable training examples remained. For the preference stage, GPT-4.1 and DeepSeek-R1 acted as judges, and only pairs on which both agreed and which matched human preferences were kept, a set Ai2 puts at 95 percent agreement.

The most effective single filter was also the simplest. Ai2 says dropping synthetic reports containing long stretches of uncited text outperformed more elaborate filtering combinations — a reminder that the bottleneck in scientific grounding is citation discipline, not model size. The model does not retrieve anything itself: retrieval and the mapping of citations to sources remain the surrounding pipeline's job, and Ai2 warns that using a prompt format different from its recommended template can degrade output.

What ships alongside the weights matters for institutions. The release includes the SFT checkpoint, the preference dataset and prompts, and an example workflow for generating reports from a local PDF corpus, so a lab can run report generation on its own infrastructure rather than sending unpublished or sensitive material to a third-party API. The model weights are Apache 2.0; the released training data and prompts carry a CC BY-NC 4.0 licence, so the collection should not be treated as wholly free for commercial use.

Ai2 is unusually explicit about the limits. It says most training and evaluation work was completed in 2025 and that it did not re-run full evaluations against 2026 frontier models, so its benchmark numbers validate an engineering approach rather than asserting a standing against current systems. Early traction is real but modest: of 374 users who tried Fast mode, 29.1 percent used it on two or more days, and 23 percent never switched back to Thinking mode.

The broader lesson is about where agentic research tooling is heading. A narrow, downloadable model that writes cited reports over local data removes a proprietary API call from the critical path and gives universities and companies a way to keep unpublished work in house. The competitive question for the frontier labs is whether general-purpose models can match the citation discipline of a small model that was trained specifically for it.