The UK is the first to release AI model security detection tools to identify and evaluate related risks
阿豆学长长ov
发表于 2024-5-13 11:25:17
258
0
0
Caixin News, May 12th (Editor Niu Zhanlin) - The UK Artificial Intelligence (AI) Security Research Institute released a new testing platform on Friday aimed at strengthening the monitoring of security risks in advanced AI models.
It is reported that the toolbox is called Inspect and can be used to evaluate AI models in a range of fields, including their core knowledge, reasoning ability, and autonomy. By releasing under an open source license, this means that Inspect can be used for free by the global AI community.
Last October, the UK announced the establishment of the Artificial Intelligence Security Research Institute, which will research and test new AI models; In February of this year, the UK also announced that it will invest over £ 100 million to launch nine new research centers and provide technical training to AI regulatory agencies.
At a press conference, the UK Institute for Artificial Intelligence Security stated that Inspect is a software library that allows testers to evaluate the specific capabilities of individual AI models and then give a score based on the results.
Inspect can be used starting from Friday, which is also the AI security testing platform first launched by nationally supported institutions.
Under the current wave of AI competition, more and more AI models will be launched this year, making it more urgent than ever to promote the development of AI security.
However, it is still quite difficult to benchmark AI models at present, as the most complex AI models today are basically "black boxes", and their infrastructure, training data, and other key details are usually kept confidential by the companies that created them and not disclosed to the public.
So, how did Inspect address this challenge? Mainly through its scalability, it can adapt and accept new testing technologies. The built-in components of Inspect can be enhanced or extended through third-party software packages written in Python.
Inspect consists of three basic components: dataset, solver, and scorer. The dataset is used to evaluate the sample set for testing, the solver is a component that performs actual testing work, and the scorer is responsible for evaluating the work results of the solver, ultimately generating a comprehensive evaluation of the performance of the AI model. This design allows Inspect to flexibly adapt to different testing needs and evaluation standards.
As part of the UK's ongoing leadership in the field of AI security, I have approved the open source Inspect, which demonstrates the UK's unique talent and creativity in innovation and technological development, and consolidates our position as a world leader in this field, according to UK Minister of Science Michelle Doneland.
Ian Hogarth, Chairman of the Institute of Artificial Intelligence Security, claims that successful AI security testing collaboration means having a shared and accessible evaluation method, and we hope that Inspect can become the cornerstone of AI security research, research organizations, and academia.
CandyLake.com 系信息发布平台,仅提供信息存储空间服务。
声明:该文观点仅代表作者本人,本文不代表CandyLake.com立场,且不构成建议,请谨慎对待。
声明:该文观点仅代表作者本人,本文不代表CandyLake.com立场,且不构成建议,请谨慎对待。
猜你喜欢
- Robin Lee: The average daily adjustment amount of Wenxin Model exceeded 1.5 billion, 30 times more than that of a year ago
- Will DeepMind's open-source biomolecule prediction model win the Nobel Prize and ignite a wave of AI pharmaceuticals?
- "AI new generation" big model manufacturer Qi "roll" agent, Robin Lee said that it will usher in an era of "making money by thinking"
- Robin Lee said that the illusion of the big model has basically eliminated the actual measurement of ERNIE Bot?
- Upgrade the war! Elon Musk sues OpenAI: Monopolizing the market and promoting the militarization of AI pose great risks!
- AI Weekly | Yang Zhilin claims that Kimi has over 36 million monthly active users; Robin Lee: The illusion of big model is basically eliminated
- ERNIE Bot has more than 400 million users, Baidu Wu Tian: the big model is reshaping the industrial intelligence engine
- In October of this year, Tesla Model Y won the sales championship for first tier and new first tier city models
- Alibaba CEO Wu Yongming: AI development requires a batch of open-source models of different scales and fields
- Baidu's Q3 core net profit increased by 17%, exceeding expectations. Wenxin's large model daily usage reached 1.5 billion
-
知名做空机构香橼研究(Citron Research)周四(11月21日)在社交媒体平台X上发布消息称,该公司已决定做空“比特币大户”微策略(Microstrategy)这家公司,并认为该公司已经将自己变身成为一家比特币投资基金 ...
- caffycat
- 昨天 11:18
- 支持
- 反对
- 回复
- 收藏
-
每经AI快讯,11月20日,文远知行宣布旗下自动驾驶环卫车S6与无人扫路机S1分别在新加坡滨海湾海岸大道与滨海艺术中心正式投入运营。据介绍,这是新加坡首个商业化运营的自动驾驶环卫项目。 ...
- star8699
- 3 天前
- 支持
- 反对
- 回复
- 收藏
-
上证报中国证券网讯(记者王子霖)11月20日,斗鱼发布2024年第三季度未经审计的财务报告。本季度斗鱼依托丰富的游戏内容生态,充分发挥主播资源和新业务潜力,持续为用户提供高质量的直播内容及游戏服务,进一步 ...
- goodfriendboy
- 3 天前
- 支持
- 反对
- 回复
- 收藏
-
人民网北京11月22日电 (记者栗翘楚、任妍)2024广州车展,在新能源汽车占据“半壁江山”的同时,正加速向智能网联新能源汽车全面过渡,随着“端到端”成为新宠,智能驾驶解决方案成为本届广州车展各大车企竞 ...
- 3233340
- 昨天 17:06
- 支持
- 反对
- 回复
- 收藏