Huang Renxun's latest speech reveals that Nvidia's chip upgrade plan will update GPUs once a year
六月清晨搅
发表于 2024-6-3 13:23:50
189
0
0
On the evening of June 2nd Beijing time, on the eve of the opening of the Computex Taipei International Computer Show, NVIDIA founder and CEO Huang Renxun gave a keynote speech titled "Unleashing the New Industrial Revolution". He spent two hours elaborating on his understanding of "GPU accelerating AI computing revolution" and "AI factory".
Facing a total audience of 6500, he publicly showcased the company's strongest performance product, the GB200 motherboard, on stage. This motherboard is equipped with two Blackwell B200 GPU chips and one Grauce CPU chip, combined into one through its interconnection technology. The product made its debut at the Nvidia GTC conference in March this year. According to Huang Renxun, Blackwell products have been fully put into production and an enhanced version of the Blackwell Ultra AI chip will continue to be launched next year.
Huang Renxun believes that as the CPU expansion speed slows down, it will eventually come to a basic stop. However, the amount of data that needs to be processed continues to grow exponentially, ultimately leading to computational inflation and an increase in computational costs.
The GPU will be the key to changing all of this. Compared to Nvidia's Pascal GPU released in 2016, Blackwell GPU's computing power (corresponding to artificial intelligence floating-point computing power) has increased by 1000 times, almost surpassing Moore's Law's growth during its optimal period.
While computing power is improving, costs are constantly decreasing. Previously, using Pascal products to train a GPT-4 model would consume up to 1000 gigawatt hours of energy (1 gigawatt hour equals 1 million kilowatt hours), while using Blackwell products only required 3 gigawatt hours.
According to Huang Renxun's consistent belief that "the more you buy, the more you save", the combination of GPU and CPU achieves up to 100 times faster computing while only increasing power consumption by three times. When converted, the average unit performance is 25 times higher than using CPU alone, significantly achieving energy-saving and cost reducing effects.
During the speech, Huang Renxun personally moved a larger DGX server. This server is connected to 8 Blackwell GPUs and uses air cooling technology for heat dissipation. At present, this product is used by AI servers that are being purchased globally and is also a core device in major data centers.
According to Huang Renxun's vision, as artificial intelligence models continue to expand, the requirements for GPU performance will also become higher. Traditional data centers will evolve into "AI factories", and the cornerstone of factories is super GPUs.
Super GPUs mainly follow the path of interconnection and clustering, connecting more and more GPUs through Nvidia's NVLink interconnection technology to form a single, ultra large scale GPU. In the MGX data center solution showcased on site, a "super GPU" will accommodate a total of 72 GPUs, improving performance by 9 times but only increasing power by 10 times, capable of accommodating AI large language models with parameters reaching billions of dollars. Huang Renxun believes that this super GPU is the true form of GPU.
According to its introduction, the "AI factory" composed of numerous BlackWell system clusters contains 32000 GPUs, with an area larger than a basketball court.
In this speech, Huang Renxun also emphasized the annual upgrade roadmap of Nvidia's chip products. The company will adhere to the route of "iterating the new architecture once a year" in the future, breaking Moore's Law, which used to be updated every two years. The new architecture iterated every year will also cover the entire data center GPU product line.
He also publicly announced for the first time the names of the next generation GPU and CPU architecture. The next generation CPU is named "Vera" and the GPU is named "Rubin", inspired by Vera Rubin, a pioneer in dark matter research in the universe and an American female astronomer.
As early as a month ago, there were rumors in the industry that Nvidia's next generation R series AI chips may adopt TSMC's 3-nanometer process technology, use CoWoS-L packaging technology, and be equipped with the new generation HBM4 high bandwidth memory technology. It is expected to achieve large-scale production in the fourth quarter of 2025.
In addition, Huang Renxun also introduced the implementation of a series of new products and services by Nvidia in this speech, including NIM cloud native microservices that help enterprises deploy AI models, a new Ethernet Spectrum X specifically designed for AI, and Nvidia's robot technology platform Isaac, among others.
The CEO also specifically mentioned the combination of artificial intelligence and robots, believing that the application of robot technology goes far beyond humanoid robots. "Mechanization will become the norm, factories will fully realize automation, robots will work together to manufacture a series of mechanized products."
CandyLake.com 系信息发布平台,仅提供信息存储空间服务。
声明:该文观点仅代表作者本人,本文不代表CandyLake.com立场,且不构成建议,请谨慎对待。
声明:该文观点仅代表作者本人,本文不代表CandyLake.com立场,且不构成建议,请谨慎对待。
猜你喜欢
- ASME's stock price fell by 6%, and other chip stocks followed suit and fell
- NVIDIA invests in Japanese AI research and development startup Sakana AI
- Global market: Nasdaq plummets by over 3%, Nvidia drops by over 9%, international oil prices plummet
- Nvidia CEO Huang Renxun sold approximately $27.6 million worth of Nvidia stock
- Global antitrust authorities' crackdown 'on Nvidia responds
- Falling again late at night! Giant Nvidia responds to negative sentiment, with a total market value evaporating by over 3.84 trillion yuan in 5 trading days
- The market value evaporated over 400 billion US dollars in a week! Is Nvidia's level of turbulence twice that of Bitcoin?
- Multiple negative factors stimulate a significant pullback in Nvidia's stock price, according to Global Finance
- Overview | Multiple negative factors stimulate a significant correction in Nvidia's stock price
- Huang Renxun sells 240000 shares of Nvidia stock, cashing out over $630 million since June
-
过去一周的时间里,有关苹果微信“二选一”的话题持续霸占各个平台热搜,甚至有媒体还在微博发起了“如果苹果微信二选一,你选择iPhone还是微信?”的投票,当然结果是微信取得了压倒性的胜利。 从最新的 ...
- lub_pig
- 前天 17:05
- 支持
- 反对
- 回复
- 收藏
-
今日,特斯拉AI团队发布产品路线图,其中,预计2025年第一季度在中国和欧洲推出完全自动驾驶(FSD),但仍有待监管批准。 自2016年以来,马斯克一直在探索特斯拉的FSD自动驾驶方案。2024年,特斯拉FSD V12 ...
- seisei
- 3 天前
- 支持
- 反对
- 回复
- 收藏
-
【全球市场】1、道指跌0.54%,纳指涨0.25%,标普跌0.30%。2、特斯拉涨近5%,亚马逊涨超2%。3、纳斯达克中国金龙指数涨0.88%,蔚来涨超14%。
- wishii
- 前天 22:03
- 支持
- 反对
- 回复
- 收藏
-
【ASML CEO回应对华出口限制:会有更多应对措施】当地时间9月4日,荷兰计算机芯片设备供应商ASML首席执行官Christophe Fouquet在花旗银行的一场会议上表示,美国限制ASML对华出口是出于“经济动机”。他预计该公司应 ...
- mbgg2797
- 3 天前
- 支持
- 反对
- 回复
- 收藏