OpenAI's "unspeakable secrets" have been made public? The method of using YouTube data to train models for acquisition is not glamorous
忧郁草民乜
发表于 2024-3-19 21:47:28
1228
0
0
As the GPT big model continues to advance, OpenAI seems to face only a lot of criticism. Apart from Musk's repeated questioning of "open source", the data source for training the big model in OpenAI is unclear, or it has laid a mine for infringement litigation for this company.
The training of current AI large models requires large-scale datasets with huge amounts of data to be fed on the data side. According to public information, the data sources of OpenAI may include but are not limited to: publicly available data sets, such as various resources on the Internet, such as books, web pages, news articles, academic papers, etc; Datasets provided by partners and third-party data providers; Specific field data purchased, such as medical, legal, or scientific literature; Synthesize data, OpenAI may use its own model to generate data, such as training and improving the model through its own output; Crowdsourcing and community contribution data.
The source of data is not the most important issue, and the focus of external attention is how OpenAI obtains this data.
Did you steal it?
As reported by Business Insider, OpenAI's use of a large number of YouTube videos to train models has become an "open secret", benefiting products including its newly launched Sora model in the field of cultural and biological videos. The mystery lies in how OpenAI can obtain sufficient YouTube content.
You should know that YouTube is a subsidiary of Google. In 2006, YouTube was acquired by Google for $1.65 billion and rapidly grew into the world's largest video sharing platform with Google's support.
Google has always been committed to developing AI and is one of OpenAI's main competitors. Naturally, it will not provide its own gold mine to users for free. YouTube has long banned downloading for commercial purposes and will also restrict the downloading of a large amount of YouTube video data. Under such strict control, individual users have also been affected. Some have stated that even downloading a YouTube video can be very slow, taking several hours to complete.
A common guess is that OpenAI used web crawlers to "steal" YouTube data. OpenAI has admitted to launching a web crawler robot called GPTBot, which is used to crawl and collect data for large-scale model training.
OpenAI executives are evasive about related issues, which indirectly deepens people's impression of it as a "data thief". The Wall Street Journal recently asked OpenAI Chief Technology Officer Mira Murati if the startup is using videos from YouTube, Instagram, and Facebook to train Sora.
"I'm actually not sure about this," she said. When asked again about the source of the training data, Murati refused to answer, "I won't disclose any details."
According to a recent report from Business Insider, a person familiar with OpenAI operations stated that the company has assigned a tightly protected team to obtain training data, and how to obtain this data is a confidentiality issue.
The AI field with dense fences
The use of crawlers is not tolerated by Google, as its YouTube platform prohibits the use of robots and other automated methods to crawl its videos.
But for OpenAI, accessing YouTube videos in a way that violates Google's terms of service may not be illegal. The case law and "fair use" principle in the United States grant companies the right to freely use online content in different ways.
In short, Google, OpenAI, and other technology companies currently believe that using copyrighted content for artificial intelligence model training is also legal. Regulatory authorities have not yet made clear regulations on this matter. The arena of artificial intelligence remains a vast wilderness, with game rules related to data either yet to be determined or ignored.
Manufacturers are competing to enter and build their own technological barriers.
OpenAI and other large model developers have previously disclosed their training data sources in published research papers, but this practice is no longer prevalent as competition intensifies. Everyone wants to retain their technical secrets in order to gain a relative advantage, especially for top manufacturers who hold a favorable position. The open source competition is also a manifestation of manufacturers trying to keep their own trump cards.
The only certainty is that with further iteration of generative AI technology, similar disputes will only increase.
Big companies are more likely to become targets of criticism. Taking data as an example, even if they dare to take responsibility and bear high data procurement costs, achieving complete compliance in data acquisition is not easy. Due to the large number of parameters, large models require the use of distributed computing and cloud services for training and deployment, which increases the risk of data theft, tampering, abuse, or leakage.
How to balance personal privacy protection and encourage technological innovation, and how to find the optimal path between enterprise survival and compliant production, has become an unavoidable issue for every company committed to generative AI.
CandyLake.com 系信息发布平台,仅提供信息存储空间服务。
声明:该文观点仅代表作者本人,本文不代表CandyLake.com立场,且不构成建议,请谨慎对待。
声明:该文观点仅代表作者本人,本文不代表CandyLake.com立场,且不构成建议,请谨慎对待。
猜你喜欢
- Faraday Future: Second brand FX plans to launch two models with a price not exceeding $50000
- Robin Lee: The average daily adjustment amount of Wenxin Model exceeded 1.5 billion, 30 times more than that of a year ago
- Will DeepMind's open-source biomolecule prediction model win the Nobel Prize and ignite a wave of AI pharmaceuticals?
- "AI new generation" big model manufacturer Qi "roll" agent, Robin Lee said that it will usher in an era of "making money by thinking"
- Robin Lee said that the illusion of the big model has basically eliminated the actual measurement of ERNIE Bot?
- AI Weekly | Yang Zhilin claims that Kimi has over 36 million monthly active users; Robin Lee: The illusion of big model is basically eliminated
- ERNIE Bot has more than 400 million users, Baidu Wu Tian: the big model is reshaping the industrial intelligence engine
- In October of this year, Tesla Model Y won the sales championship for first tier and new first tier city models
- Alibaba CEO Wu Yongming: AI development requires a batch of open-source models of different scales and fields
- Baidu's Q3 core net profit increased by 17%, exceeding expectations. Wenxin's large model daily usage reached 1.5 billion
-
知名做空机构香橼研究(Citron Research)周四(11月21日)在社交媒体平台X上发布消息称,该公司已决定做空“比特币大户”微策略(Microstrategy)这家公司,并认为该公司已经将自己变身成为一家比特币投资基金 ...
- caffycat
- 11 小时前
- 支持
- 反对
- 回复
- 收藏
-
每经AI快讯,11月20日,文远知行宣布旗下自动驾驶环卫车S6与无人扫路机S1分别在新加坡滨海湾海岸大道与滨海艺术中心正式投入运营。据介绍,这是新加坡首个商业化运营的自动驾驶环卫项目。 ...
- star8699
- 前天 19:48
- 支持
- 反对
- 回复
- 收藏
-
上证报中国证券网讯(记者王子霖)11月20日,斗鱼发布2024年第三季度未经审计的财务报告。本季度斗鱼依托丰富的游戏内容生态,充分发挥主播资源和新业务潜力,持续为用户提供高质量的直播内容及游戏服务,进一步 ...
- goodfriendboy
- 前天 20:09
- 支持
- 反对
- 回复
- 收藏
-
人民网北京11月22日电 (记者栗翘楚、任妍)2024广州车展,在新能源汽车占据“半壁江山”的同时,正加速向智能网联新能源汽车全面过渡,随着“端到端”成为新宠,智能驾驶解决方案成为本届广州车展各大车企竞 ...
- 3233340
- 5 小时前
- 支持
- 反对
- 回复
- 收藏