Business IEA Says Data Center Power Demand Could Double to 1,000 TWh by 2030, With AI Supplying Three Quarters of the Growth Chatbots ChatGPT Now Transcribes as You Talk: OpenAI Removes the 10-Minute Cap and Streams Words Live on Every Plan Business Ex-Alibaba Executive's Everful Raises $48.5 Million to Put AI Agents in Charge of Sourcing From 30,000 Factories AI Agents Google Built a Mirror Dimension of the Internet to Train Its Chrome AI Agents Without Breaking the Real Web Productivity Canva Finally Adds an Off Switch for Its Generative AI Features, and a Filter to Hide AI-Made Templates Business Anthropic Begins Trading Today: 980 Million Shares at $83, a $1.5 Trillion Valuation and the Largest IPO on Record News Google Books Blue Origin New Glenn to Launch TPU-Carrying AI Satellites in Early 2029 Security Hackers Used the AI Penetration Tool ARTEX to Disrupt European Commission Systems for Over Ten Days Business IEA Says Data Center Power Demand Could Double to 1,000 TWh by 2030, With AI Supplying Three Quarters of the Growth Chatbots ChatGPT Now Transcribes as You Talk: OpenAI Removes the 10-Minute Cap and Streams Words Live on Every Plan Business Ex-Alibaba Executive's Everful Raises $48.5 Million to Put AI Agents in Charge of Sourcing From 30,000 Factories AI Agents Google Built a Mirror Dimension of the Internet to Train Its Chrome AI Agents Without Breaking the Real Web Productivity Canva Finally Adds an Off Switch for Its Generative AI Features, and a Filter to Hide AI-Made Templates Business Anthropic Begins Trading Today: 980 Million Shares at $83, a $1.5 Trillion Valuation and the Largest IPO on Record News Google Books Blue Origin New Glenn to Launch TPU-Carrying AI Satellites in Early 2029 Security Hackers Used the AI Penetration Tool ARTEX to Disrupt European Commission Systems for Over Ten Days

Grok 4.7 Tops a New AI Cyber-Defense Index — by Tying Xiaomi's Open-Weight MiMo-V2.6-Pro at 56, With Each Task Costing $11.67

Grok 4.7 Tops a New AI Cyber-Defense Index — by Tying Xiaomi's Open-Weight MiMo-V2.6-Pro at 56, With Each Task Costing $11.67

Elon Musk celebrated Grok 4.7 taking the top spot on Artificial Analysis' new Cyber Index — but the leaderboard shows a tie: Xiaomi's open-weight MiMo-V2.6-Pro matched its composite score of 56, with GPT-6 Luna (Max) third at 53. Grok 4.7 posted 68% pass@1 on CWE-Bench-AA and 74% on CyberGym-E2E-AA patching, at a steep $11.67 per task.

Elon Musk had a clean win to post on X this weekend: Grok 4.7 is "#1 on the AA Cyber Index." The leaderboard itself tells a more complicated story. On the Cyber Index — a cyber-defense benchmark launched around September 28 by independent evaluator Artificial Analysis — Grok 4.7 in its xHigh reasoning setting scored a composite 56, which ties it with Xiaomi's open-weight MiMo-V2.6-Pro, according to Crypto Briefing's read of the rankings and subsequent coverage. GPT-6 Luna (Max) sits third at 53.

The index is not a chatbot arena. It tests AI agents on enterprise cyber-defense tasks: finding vulnerabilities inside real codebases, reproducing them, and shipping working patches. It combines three evaluations — CWE-Bench-AA, DeepsecBench-AA and CyberGym-E2E-AA — all executed by Artificial Analysis itself, and it launched alongside an industry group, the Artificial Analysis Cyber Index Alliance, whose participants reportedly include IBM, NVIDIA, Collinear AI and Vercel.

Grok 4.7's composite rests on strong sub-results. On CWE-Bench-AA it recorded a 68% pass@1 rate — meaning the task was solved correctly on the first attempt, with no retries — which tied for the lead on that test. On CyberGym-E2E-AA, the end-to-end patching evaluation, it hit a 74% success rate. Those are frontier-level numbers on work that security teams actually care about: not describing a vulnerability, but finding it and fixing it.

The catch is the bill. Grok 4.7 costs $11.67 per task on the index — a figure Crypto Briefing flagged as high next to cheaper competing models. MiMo-V2.6-Pro, which delivers the same composite score as an open-weight model, lands in what the coverage describes as the most attractive quadrant of the index's score-versus-cost comparison. When two models tie on capability, cost and integration tend to decide procurement.

There is also a gap between the announcement and the data. Musk's post presented a first place; the reported leaderboard shows a shared one. That distinction matters less for bragging rights than for the enterprise buyers the result is aimed at: a tie with an open-weight Chinese model at a fraction of the cost is a different procurement story than an outright win, and it fits a pattern that has defined 2026 — US frontier labs holding narrow leads at premiums while open-weight models close the gap for less.

A few caveats belong in any procurement conversation. The rankings as reported trace to Artificial Analysis' leaderboard as read by Crypto Briefing; the underlying page could not be independently loaded at publication, and Musk's own post did not mention the tie. Grok 4.7 comes from SpaceXAI, the entity formed after xAI's merger with SpaceX, and follows Grok 4.6, which was benchmarked in September.

Benchmarks this new deserve skepticism — the index is barely a week old and no independent replication exists yet. But the direction is worth noting: security capability is becoming a quantified, procurement-grade metric, with a vendor alliance formed around a third-party evaluator. If AI cyber-defense tooling keeps improving at benchmark pace, the buyer's question shifts from "can a model find this bug" to "which model finds it, patches it, and what does each attempt cost."

Comments (0)

Log in to join the discussion

Log In

No comments yet