Meta's New Business Terms Let It Crawl Publisher Websites for AI Training From October 30, With No Opt-Out

Meta is quietly rewriting the rules of what it can take. Starting October 30, revised commercial terms of service will let the company deploy automated crawlers, bots, scrapers and spiders against any website "associated with" a business account on Facebook, Instagram, WhatsApp or Messenger — and use whatever it finds to train and improve Meta's AI products. Nieman Lab first flagged the change, and legal experts who reviewed it say it amounts to one of the broadest content-grabbing rights any platform has claimed to date.

The operative language is sweeping. Business users grant Meta — "or any entity acting on Meta's behalf" — permission to "access, index, cache, analyze, collect, retrieve or crawl" domains, web pages and URLs associated with their products or services, and to "periodically pull updates" from them. Meta may then use content from those pages to "provide, develop, improve, research, train and maintain the integrity of" its products, services and features. Unlike earlier ad-related terms, which covered URLs supplied in connection with advertisements and tied use to advertising purposes, the new wording is not limited to ads at all.

There is no opt-out for businesses that want to stay on the platforms. The terms state that companies which do not agree "may stop all access or use of our Products for business or commercial purposes." The update also lands just weeks after Meta launched Meta One, a subscription that charges businesses and creators for including links in posts and short videos. As Nieman Lab put it: Meta has started charging users to post links to content it can now crawl for free.

A Meta spokesperson pushed back on the framing. "This is false. There's no change to how Meta uses web crawlers," Andy Stone wrote, adding that "as always, content owners can use robots.txt flags to indicate their preferences" and that Meta has no plans to treat the new terms as a basis for ignoring robots.txt blocks on news sites. According to Stone, the update exists so Meta can "pull accurate information about products for sale on third-party websites when making on-platform ad and content recommendations, not about scraping news sites." Meta describes the revision as consolidating crawler language previously scattered across several agreements.

Legal experts are not reassured. Cornell Law School professor James Grimmelmann told Nieman Lab the language could permit Meta to train AI on publishers' website content and potentially deploy some of that content in products that compete with the publishers themselves. Media attorney Matt Topic of Loevy and Loevy called it "a remarkable provision to bury in terms of service, given that this would give Meta access to material that would likely cost many millions of dollars in a licensing market." Ars Technica's comparison of old and new policies found one genuinely new element: permission to create "test credentials," which experts warn could be used to automate scraping behind paywalls. Meta did not answer Ars's request to clarify that clause.

Publisher groups reacted sharply. Jason Kint, who leads the digital media trade group DCN, wrote that Meta wants to "grant itself the rights to scrape websites across the open web — potentially powering its AI empire, including Muse, without licensing deals." Stephen Beale, founder of The Steampunk Explorer, told Nieman Lab he depends on Facebook for traffic but is considering leaving the platform over the update.

The timing is delicate. Meta has spent the past year signing AI licensing deals with CNN, Fox News, USA Today and People Inc., following the path OpenAI paved. Those deals now coexist with a terms-of-service clause that appears to let Meta reach much wider content for free. Whether courts would read the clause as consent for AI training is an open question — three legal experts who spoke to Nieman Lab said enforceability is unclear — but the practical effect is that publishers must either accept the terms, fight them in court, or walk away from two of the internet's largest distribution platforms.