The CEO of the biggest digital and print writer within the U.S. has accused Google of being a nasty actor for crawling its web sites to assist the search large’s AI merchandise.
Neil Vogel, CEO of Folks, Inc. (previously Dotdash Meredith), a writer that operates over 40 manufacturers, together with Folks, Meals & Wine, Journey & Leisure, Higher Houses & Gardens, Actual Easy, Southern Residing, AllRecipes, and others, mentioned that Google is just not enjoying truthful as a result of it makes use of the identical bot to crawl web sites to index them for the Google search engine because it does to assist its AI options.
“Google has one crawler, which implies they use the identical crawler for his or her search, the place they nonetheless ship us site visitors, as they do for his or her AI merchandise, the place they steal our content material,” mentioned Vogel, talking on the Fortune Brainstorm Tech convention this week.
He famous that three years in the past, Google Search accounted for about 65% of the corporate’s site visitors and that has since dropped to the “excessive 20s.” (Vogel shared an much more startling statistic with AdExchanger final month, saying that as of a number of years in the past, Google’s site visitors accounted for as a lot as 90% of Folks Inc.’s site visitors from the open net.)
“I’m not complaining. We’ve grown our viewers. We’ve grown our income,” Vogel advised convention attendees. “We’re doing nice. What is just not proper about that is: you can not take our content material to compete with us.”
Vogel believes publishers want extra leverage within the AI period, which is why he feels it’s obligatory to dam AI crawlers — automated applications that scan web sites to coach AI techniques — as that may pressure them into content material offers. His firm, for instance, has a take care of OpenAI, which Vogel described as a “good actor.”
Folks, Inc. has been leveraging net infrastructure firm Cloudflare’s newest answer to dam AI crawlers that don’t pay, prompting AI gamers to method the writer with potential content material offers. Whereas Vogel wouldn’t instantly title the businesses concerned, he mentioned they had been “massive LLM suppliers.” No offers have been signed but, however Vogel mentioned the corporate is “a lot additional alongside” than earlier than it adopted the crawler-blocking answer.
Techcrunch occasion
San Francisco
|
October 27-29, 2025
Nonetheless, Vogel identified, Google’s crawler can’t be blocked as a result of doing so would additionally stop the writer’s web sites from being listed in Google Search, reducing off that “20%-ish” of site visitors that Google nonetheless delivers.
“They know this, and so they’re not splitting their crawler. So they’re an intentional unhealthy actor right here,” Vogel declared.
Janice Min, the editor-in-chief and CEO at e-newsletter supplier Ankler Media, agreed, calling massive tech corporations like Google and Meta longtime “content material kleptomaniacs.”
“I don’t see the profit to us in partnering with any AI firm proper now,” she mentioned, including that her firm blocks AI crawlers.
In the meantime, Cloudflare CEO Matthew Prince, whose firm makes the AI-blocking answer (and who was additionally on the panel), mentioned he believed that issues would nonetheless change sooner or later in terms of how the AI corporations behave. He suspected these modifications might be prompted by new rules.
The Cloudflare exec additionally questioned whether or not combating the AI corporations utilizing authorized options round issues like copyright regulation, created for the pre-AI period, was the proper reply.
“I feel that it’s a idiot’s errand to go down that path, as a result of, in copyright regulation, sometimes, the extra by-product one thing is, the extra it’s protected below truthful use…What these AI corporations are doing is that they’re really creating derivatives,” Prince mentioned. “And so for those who have a look at the perfect case regulation that’s come out up to now, it’s really mentioned that the use by Anthropic and others — the explanation Anthropic settled the opposite day with all of the guide publishers for $1.5 billion — was for them to have the ability to protect the optimistic copyright ruling that they obtained.”
Prince additionally proclaimed that “every thing that’s fallacious with the world right now is, at some stage, Google’s fault,” as a result of the search large had taught publishers to worth site visitors over unique content material creation, triggering publishers like BuzzFeed to write down for clicks. Nonetheless, he admitted that Google was in a tricky spot proper now from a aggressive standpoint.
“Internally, they’re having large fights about what they do, and my prediction is that, by this time subsequent 12 months, Google might be paying content material creators for crawling their content material and taking it and placing it in AI fashions,” he mentioned.
