Opinion 48 AI Agents 'Discovered' a Maya Village That Archaeologists Had Published More Than a Year Earlier Security Study: AI Chatbots Recommend Fake Retail Websites in Up to 15 Percent of Shopping Queries — Perplexity Worst, Gemini Best News SpaceX's AI Arm Cuts About 60 Grok Imagine Staffers, Leaving a Skeleton Crew, as Coding Tools and Grok Bot Take Priority AI Agents OpenAI Launches ChatGPT Wallet: Your Dots Agent Can Now Check Out With Your Visa, Mastercard or Amex Business SpaceX Plans $74 Billion of Compute: $24 Billion in Texas and a $50 Billion Arizona Campus Built for 6 Gigawatts AI Agents Mirendil Raises $1 Billion Series A Five Months After Its Seed, Betting One Researcher Plus Agents Can Do Frontier Work Business Cisco Grew 24 Percent to $18.5 Billion, Its Fastest in 15 Years, and Raised Its AI Infrastructure Target to $9 Billion News DeepX Tapes Out DX-M2 on Samsung 2nm: 80 TOPS at 5 Watts to Run 100-Billion-Parameter Models on Robots Opinion 48 AI Agents 'Discovered' a Maya Village That Archaeologists Had Published More Than a Year Earlier Security Study: AI Chatbots Recommend Fake Retail Websites in Up to 15 Percent of Shopping Queries — Perplexity Worst, Gemini Best News SpaceX's AI Arm Cuts About 60 Grok Imagine Staffers, Leaving a Skeleton Crew, as Coding Tools and Grok Bot Take Priority AI Agents OpenAI Launches ChatGPT Wallet: Your Dots Agent Can Now Check Out With Your Visa, Mastercard or Amex Business SpaceX Plans $74 Billion of Compute: $24 Billion in Texas and a $50 Billion Arizona Campus Built for 6 Gigawatts AI Agents Mirendil Raises $1 Billion Series A Five Months After Its Seed, Betting One Researcher Plus Agents Can Do Frontier Work Business Cisco Grew 24 Percent to $18.5 Billion, Its Fastest in 15 Years, and Raised Its AI Infrastructure Target to $9 Billion News DeepX Tapes Out DX-M2 on Samsung 2nm: 80 TOPS at 5 Watts to Run 100-Billion-Parameter Models on Robots

Classifying Thousands of Records Cheaply and Accurately

Sampling, small models and confidence routing bring bulk classification costs down by an order of magnitude.

Bulk classification is the least glamorous AI task and often the most valuable. It is also where naive implementations burn the most budget.

1. Define categories with boundaries

Ambiguous labels produce ambiguous results. For each category, write a rule and one borderline example. If two reviewers disagree on a sample, the definition is not finished.

2. Label a gold set by hand

Two hundred examples is enough to start. Hand-label them carefully — this set is your only measure of whether anything works.

3. Start with a small model

Classification rarely needs frontier reasoning. Test a small, cheap model first. If it reaches acceptable accuracy on the gold set, stop there.

4. Add confidence routing

Ask the model to return both a label and a confidence value. Auto-accept high confidence, send the middle band to a larger model, and route the lowest band to human review. This usually captures most of the savings without losing accuracy.

5. Use batch processing

For non-interactive workloads, asynchronous batch endpoints cost substantially less. A nightly job is indistinguishable from a real-time one from the user's perspective.

6. Monitor drift

Re-run the gold set monthly. Input distributions change — new products, new phrasing, seasonal patterns — and accuracy degrades silently when they do.

Comments (0)

Log in to join the discussion

Log In

No comments yet