Business IEA Says Data Center Power Demand Could Double to 1,000 TWh by 2030, With AI Supplying Three Quarters of the Growth Chatbots ChatGPT Now Transcribes as You Talk: OpenAI Removes the 10-Minute Cap and Streams Words Live on Every Plan Business Ex-Alibaba Executive's Everful Raises $48.5 Million to Put AI Agents in Charge of Sourcing From 30,000 Factories AI Agents Google Built a Mirror Dimension of the Internet to Train Its Chrome AI Agents Without Breaking the Real Web Productivity Canva Finally Adds an Off Switch for Its Generative AI Features, and a Filter to Hide AI-Made Templates Business Anthropic Begins Trading Today: 980 Million Shares at $83, a $1.5 Trillion Valuation and the Largest IPO on Record News Google Books Blue Origin New Glenn to Launch TPU-Carrying AI Satellites in Early 2029 Security Hackers Used the AI Penetration Tool ARTEX to Disrupt European Commission Systems for Over Ten Days Business IEA Says Data Center Power Demand Could Double to 1,000 TWh by 2030, With AI Supplying Three Quarters of the Growth Chatbots ChatGPT Now Transcribes as You Talk: OpenAI Removes the 10-Minute Cap and Streams Words Live on Every Plan Business Ex-Alibaba Executive's Everful Raises $48.5 Million to Put AI Agents in Charge of Sourcing From 30,000 Factories AI Agents Google Built a Mirror Dimension of the Internet to Train Its Chrome AI Agents Without Breaking the Real Web Productivity Canva Finally Adds an Off Switch for Its Generative AI Features, and a Filter to Hide AI-Made Templates Business Anthropic Begins Trading Today: 980 Million Shares at $83, a $1.5 Trillion Valuation and the Largest IPO on Record News Google Books Blue Origin New Glenn to Launch TPU-Carrying AI Satellites in Early 2029 Security Hackers Used the AI Penetration Tool ARTEX to Disrupt European Commission Systems for Over Ten Days

Large Language Models: A Plain Explanation

Large Language Models: A Plain Explanation

A large language model predicts the next token from everything it has seen so far. Almost every capability and every limitation follows from that single mechanism.

A large language model is a statistical system trained to predict what comes next in a sequence of text. Training means adjusting billions of numeric parameters until those predictions become accurate across an enormous range of material.

Why that produces useful behaviour

To predict text well you must implicitly model grammar, factual associations, writing conventions and some reasoning patterns. Those capabilities are side effects of the prediction objective rather than features that were coded directly. This is why abilities appear gradually as models scale, and why nobody can specify in advance exactly what a given model will be able to do.

Where the limits come from

  • No persistent memory. Knowledge lives in the parameters; the conversation is only a working context.
  • No ground truth. A fluent sentence and a correct sentence look identical to the training objective.
  • Training cutoff. Without retrieval, the model cannot know about events after its training data ends.
  • Tokenisation artefacts. Counting letters or doing arithmetic in text form is genuinely harder than it appears.

Related terms

Tokens are the sub-word units models read and write. Parameters are the learned weights. Context window is the maximum token budget available in one request. Inference is the act of generating output from a trained model.

Comments (0)

Log in to join the discussion

Log In

No comments yet