Los Angeles, Jan 16: Wikipedia unveiled new business deals with a slew of artificial intelligence companies on Thursday as it marked its 25th anniversary.
The online crowdsourced encyclopedia revealed that it has signed up AI companies including Amazon, Meta Platforms, Perplexity, Microsoft and France’s Mistral AI.
Wikipedia is one of the last bastions of the early internet, but that original vision of a free online space has been clouded by the dominance of Big Tech platforms and the rise of generative AI chatbots trained on content scraped from the web.
Aggressive data collection methods by AI developers, including from Wikipedia’s vast repository of free knowledge, has raised questions about who ultimately pays for the artificial intelligence boom.
The Wikimedia Foundation, the nonprofit that runs the site, signed Google as one of its first customers in 2022 and announced other agreements last year with smaller AI players like search engine Ecosia.
The new deals will help one of the world’s most popular websites monetize heavy traffic from AI companies. They’re paying to access Wikipedia content “at a volume and speed designed specifically for their needs,” the foundation said. It did not provide financial or other details.
While AI training has sparked legal battles elsewhere over copyright and other issues, Wikipedia founder Jimmy Wales said he welcomes it.
Wales said the site wants to work with AI companies, not block them. But “you should probably chip in and pay for your fair share of the cost that you’re putting on us.”
The Wikimedia Foundation last year urged AI developers to pay for access through its enterprise platform and said human traffic had fallen 8 per cent. Meanwhile, visits from bots, sometimes disguised to evade detection, were heavily taxing its servers as they scrape masses of content to feed AI large language models.
The findings highlighted shifting online trends as search engine AI overviews and chatbots summarise information instead of sending users to sites by showing them links.
Wikipedia is the ninth most visited site on the internet. It has more than 65 million articles in 300 languages that are edited by some 250,000 volunteers.
The site has become so popular in part because its free for anyone to use.
“But our infrastructure is not free, right?” Wikimedia Foundation CEO Maryana Iskander said in a separate interview in Johannesburg, South Africa.
It costs money to maintain servers and other infrastructure that allows both individuals and tech companies to “draw data from Wikipedia,” said Iskander, who’s stepping down on Jan. 20, and will be replaced by Bernadette Meehan.
The bulk of Wikipedia’s funding comes from 8 million donors, most of them individuals.
“They’re not donating in order to subsidize these huge AI companies,” Wales said. They’re saying, “You know what, actually you can’t just smash our website. You have to sort of come in the right way.”
Editors and users could benefit from AI in other ways. The Wikimedia Foundation has outlined an AI strategy that Wales said could result in tools that reduce tedious work for editors.
While AI isn’t good enough to write Wikipedia entries from scratch, it could, for example, be used to update dead links by scanning the surrounding text and then searching online to find other sources.
“We don’t have that yet but that’s the kind of thing that I think we will see in the future.”
Artificial intelligence could also improve the Wikipedia search experience, by evolving from the traditional keyword method to more of a chatbot style, Wales said.
“You can imagine a world where you can ask the Wikipedia search box a question and it will quote to you from Wikipedia,” he said. It could respond by saying “here’s the answer to your question from this article and here’s the actual paragraph. That sounds really useful to me and so I think we’ll move in that direction as well. ”
Reflecting on the early days, Wales said it was a thrilling time because many people were motivated to help build Wikipedia after he and co-founder Larry Sanger, who departed long ago, set it up as an experiment.
However, while some might look back wistfully on what seems now to be a more innocent time, Wales said those early days of the internet also had a dark side.