The UK is the first to release AI model security detection tools to identify and evaluate related risks
阿豆学长长ov
发表于 2024-5-13 11:25:17
249
0
0
Caixin News, May 12th (Editor Niu Zhanlin) - The UK Artificial Intelligence (AI) Security Research Institute released a new testing platform on Friday aimed at strengthening the monitoring of security risks in advanced AI models.
It is reported that the toolbox is called Inspect and can be used to evaluate AI models in a range of fields, including their core knowledge, reasoning ability, and autonomy. By releasing under an open source license, this means that Inspect can be used for free by the global AI community.
Last October, the UK announced the establishment of the Artificial Intelligence Security Research Institute, which will research and test new AI models; In February of this year, the UK also announced that it will invest over £ 100 million to launch nine new research centers and provide technical training to AI regulatory agencies.
At a press conference, the UK Institute for Artificial Intelligence Security stated that Inspect is a software library that allows testers to evaluate the specific capabilities of individual AI models and then give a score based on the results.
Inspect can be used starting from Friday, which is also the AI security testing platform first launched by nationally supported institutions.
Under the current wave of AI competition, more and more AI models will be launched this year, making it more urgent than ever to promote the development of AI security.
However, it is still quite difficult to benchmark AI models at present, as the most complex AI models today are basically "black boxes", and their infrastructure, training data, and other key details are usually kept confidential by the companies that created them and not disclosed to the public.
So, how did Inspect address this challenge? Mainly through its scalability, it can adapt and accept new testing technologies. The built-in components of Inspect can be enhanced or extended through third-party software packages written in Python.
Inspect consists of three basic components: dataset, solver, and scorer. The dataset is used to evaluate the sample set for testing, the solver is a component that performs actual testing work, and the scorer is responsible for evaluating the work results of the solver, ultimately generating a comprehensive evaluation of the performance of the AI model. This design allows Inspect to flexibly adapt to different testing needs and evaluation standards.
As part of the UK's ongoing leadership in the field of AI security, I have approved the open source Inspect, which demonstrates the UK's unique talent and creativity in innovation and technological development, and consolidates our position as a world leader in this field, according to UK Minister of Science Michelle Doneland.
Ian Hogarth, Chairman of the Institute of Artificial Intelligence Security, claims that successful AI security testing collaboration means having a shared and accessible evaluation method, and we hope that Inspect can become the cornerstone of AI security research, research organizations, and academia.
CandyLake.com 系信息发布平台,仅提供信息存储空间服务。
声明:该文观点仅代表作者本人,本文不代表CandyLake.com立场,且不构成建议,请谨慎对待。
声明:该文观点仅代表作者本人,本文不代表CandyLake.com立场,且不构成建议,请谨慎对待。
猜你喜欢
- Meta releases heavyweight new products: $299 Quest 3S headset, AR glasses prototype, multimodal AI model
- Baidu World 2024 will be held on November 12th, and the daily average number of adjustments for the Wenxin large model has exceeded 700 million times
- 挑战Model Y 蔚来的品牌下沉“阳谋”
- Ford CEO tired of making 'boring' car models, personalized and electrified products become 'new favorites'
- Dialogue | Baidu Li Tao: The overlap between automotive intelligence and the wave of big models is a historical inevitability
- Boeing announces 10% layoffs, first delivery of 777X model postponed to 2026
- Faraday Future plans to launch the first model of its second brand by the end of next year
- Will a third brand launch hybrid models overseas? NIO responds: Continuing the pure electric technology route
- He Xiaopeng: Xiaopeng's car end large model aims to achieve a 100 kilometer takeover once next year
- Faraday Future: Second brand FX plans to launch two models with a price not exceeding $50000
-
2024年11月7日,由新华社新闻信息中心、新华社上海分社、新华社品牌工作办公室主办的“品牌·让世界更美好”中外品牌论坛在上海举办。此次论坛,理想汽车荣获“通用ESG企业评价规范”年度最佳品牌奖。理想汽车将 ...
- cool88817
- 3 小时前
- 支持
- 反对
- 回复
- 收藏
-
何思文表示,“在进博会这个平台上,我们开启的是倾听模式,通过进博会展出各类产品,收集消费者的需求和反馈,进而帮助决定未来进口到中国的产品。过去,汽车行业的许多创新源于美国加州或欧洲。我相信,中国正 ...
- MaxLucky
- 10 小时前
- 支持
- 反对
- 回复
- 收藏
-
11月5日至10日,第七届中国国际进口博览会(下称“进博会”)在国家会展中心(上海)举办。在进博会期间,平安健康医疗科技有限公司(下称“平安健康”)与美敦力(上海)管理有限公司(下称“美敦力”)达成战 ...
- Hidden2
- 前天 17:06
- 支持
- 反对
- 回复
- 收藏
-
今年上半年业绩表现低迷的百胜中国在第三季度打了个“翻身仗”。11月4日,百胜中国发布三季报显示,今年第三季度,其净利润同比增长22%。而在第一季度、第二季度,该公司净利润增长率分别为-1%、8%,第三季度净 ...
- nihaosifa
- 前天 15:35
- 支持
- 反对
- 回复
- 收藏