OpenAI and Google have reportedly transcribed YouTube videos to harvest text for their AI models, potentially violating creators’ copyrights.
According to an investigation by The New York Times and Meta, the tech giants allegedly cut corners to access as much data as possible to train their AI models.
OpenAI researchers are said to have created a speech recognition tool called Whisper, which allows audio transcription from YouTube videos. This can yield new conversational text that would make an AI system smarter.
The inquiry cites several sources who claim that more than one million hours of YouTube videos have been transcribed, despite conversations discussing how it could violate YouTube’s rules. The transcripts were then inputted into GPT-4, the advanced AI system powering the most recent version of ChatGPT’s chatbot. Google, the parent company of YouTube, was also reported to have transcribed videos to train its own AI models.
In addition to this, OpenAI president Greg Brockman was personally involved in collecting videos that were used, the Times writes.
OpenAI’s alleged use of YouTube videos could also breach Google’s policies, which prohibit using its content for “independent” applications and the “automated means” of its videos through methods like robots, botnets, or scrapers.
Are tech companies running out of training data?
The report also suggests that OpenAI had depleted its supplies of useful data in 2021, and as a result, discussed transcribing podcasts, audiobooks and YouTube videos to train its next-generation model. By then, it is said that they had mined the computer code repository GitHub, and used up databases of chess moves and data describing high school tests and homework assignments from the website Quizlet.
The Times claims that Google’s legal department requested the company’s privacy team to modify the wording of its policy to broaden the scope of actions it could take with consumer data, including the use of office tools like Google Docs.
According to the Times, Meta is also facing a shortage of available training data, and in recordings reviewed by the publication, its AI team was heard discussing the unauthorized use of copyrighted materials in an effort to keep pace with OpenAI. Having exhausted “almost available English-language book, essay, poem and news article on the internet,” the company reportedly contemplated measures such as acquiring book licenses or outright purchasing a major publishing house.
Last week, YouTube CEO Neal Mohan said that using the videos on the platform to train an AI model would be a “clear violation” of YouTube’s terms and conditions after OpenAI’s CTO “didn’t know” whether the tool was trained on YouTube videos.
Advanced systems created by OpenAI, Google, and others need vast expanses of information to learn. This need is depleting the reservoir of high-quality public data on the internet, especially as certain data owners restrict AI companies’ access. The Wall Street Journal states that there is a 90 per cent chance the demand for high-quality data will outstrip supply by 2028.
OpenAI, Google, and Meta have been approached for further comment.
Featured image: Canva
The post OpenAI and Google accused of using YouTube transcripts for AI appeared first on ReadWrite.