Business IEA Says Data Center Power Demand Could Double to 1,000 TWh by 2030, With AI Supplying Three Quarters of the Growth Chatbots ChatGPT Now Transcribes as You Talk: OpenAI Removes the 10-Minute Cap and Streams Words Live on Every Plan Business Ex-Alibaba Executive's Everful Raises $48.5 Million to Put AI Agents in Charge of Sourcing From 30,000 Factories AI Agents Google Built a Mirror Dimension of the Internet to Train Its Chrome AI Agents Without Breaking the Real Web Productivity Canva Finally Adds an Off Switch for Its Generative AI Features, and a Filter to Hide AI-Made Templates Business Anthropic Begins Trading Today: 980 Million Shares at $83, a $1.5 Trillion Valuation and the Largest IPO on Record News Google Books Blue Origin New Glenn to Launch TPU-Carrying AI Satellites in Early 2029 Security Hackers Used the AI Penetration Tool ARTEX to Disrupt European Commission Systems for Over Ten Days Business IEA Says Data Center Power Demand Could Double to 1,000 TWh by 2030, With AI Supplying Three Quarters of the Growth Chatbots ChatGPT Now Transcribes as You Talk: OpenAI Removes the 10-Minute Cap and Streams Words Live on Every Plan Business Ex-Alibaba Executive's Everful Raises $48.5 Million to Put AI Agents in Charge of Sourcing From 30,000 Factories AI Agents Google Built a Mirror Dimension of the Internet to Train Its Chrome AI Agents Without Breaking the Real Web Productivity Canva Finally Adds an Off Switch for Its Generative AI Features, and a Filter to Hide AI-Made Templates Business Anthropic Begins Trading Today: 980 Million Shares at $83, a $1.5 Trillion Valuation and the Largest IPO on Record News Google Books Blue Origin New Glenn to Launch TPU-Carrying AI Satellites in Early 2029 Security Hackers Used the AI Penetration Tool ARTEX to Disrupt European Commission Systems for Over Ten Days

Hugging Face Hands Its Model Router to OpenRouter and Kills Bring-Your-Own Keys as Open-Weight Models Hit 71.7 Percent of Routed Tokens

Hugging Face Hands Its Model Router to OpenRouter and Kills Bring-Your-Own Keys as Open-Weight Models Hit 71.7 Percent of Routed Tokens

Hugging Face moved Inference Providers language-model traffic onto OpenRouter's router on November 16, so one HF token now reaches more than 80 providers with retry-on-failure and cache-aware routing. Custom provider API keys stop working for chat models. HF puts the open-weight share of OpenRouter tokens at 71.7 percent, up from 26.8 percent a year earlier.

Hugging Face has outsourced one of the most consequential decisions in its developer platform: which company actually serves your inference request. On Monday the company switched Inference Providers, its serverless inference service, from its own custom router to OpenRouter's, saying language-model requests now go to whichever provider has the best live mix of price, speed and reliability, and get retried on another provider within the same call if the first one fails.

The practical change is bigger than the marketing. Previously, Inference Providers picked one backend per request and returned that backend's error if it failed. Now a failed or rate-limited call silently moves to the next-best provider, and traffic drains away from providers that slow down until they recover. The router accepts OpenAI's Chat Completions and Responses APIs and Anthropic's Messages API for every chat model it serves, so existing code and HF tokens keep working. Model IDs still accept suffixes like :fastest, :cheapest or a pinned provider name, and users can switch individual providers off entirely.

There is one genuinely breaking change: bring-your-own provider keys no longer work for language models. Requests are billed to the Hugging Face account or organization through the OpenRouter path, so a developer who negotiated a special rate with a specific provider loses that arrangement for chat calls. Custom keys keep working for image and video providers, which stay on the direct path along with audio generation. Hugging Face says pricing is otherwise unchanged, with no markup on provider rates.

The numbers Hugging Face cites are OpenRouter's own and should be read as company-reported rather than independently audited. OpenRouter says its recently rebuilt routing cut capacity errors by 46 percent and improved time to first token by 16.9 percent and throughput by 16.3 percent, at a measured 6 percent higher average cost per request. OpenRouter serves more than 800 trillion tokens a month to over 10 million users across more than 600 models from more than 80 providers.

The blog post is also a progress report on open-weight models. On OpenRouter, open-weight models went from 26.8 percent of tokens served in October 2025 to 71.7 percent at the end of September 2026, peaking at 77.5 percent in July, while weekly open-weight volume grew more than sixty-fold against roughly tenfold for closed models. The most-used model this week is an open-weight one, DeepSeek V4.1 Flash 1017, at 59.2 trillion tokens. On average open-weight models cost about four times less: $0.28 per million input tokens and $1.62 per million output tokens, against $1.27 and $6.36 for closed models.

The gap that remains is capability: on the Artificial Analysis Intelligence Index, the best open-weight model, Kimi K3.1 Pro, scores 46 against 65 for Anthropic's Claude Fable 5.2, at roughly a seventh of the cost per task, $3.68 against $26.54. Hugging Face's bet is that for most workloads that trade is obvious, and that the router should make it invisible too.

Routing is also cache-aware, keeping a conversation on the provider that holds its prompt cache, with an explicit X-HF-Session-Id header for developers who want deterministic placement. Both companies call this the first step of a partnership that began when Stripe completed its roughly $7.5 billion acquisition of OpenRouter earlier this month: next on the list are linking OpenRouter accounts to Hugging Face and routing more task types through the gateway. The consolidation point is shifting, in other words, from who hosts the models to who decides, request by request, where your tokens go.

Comments (0)

Log in to join the discussion

Log In

No comments yet