首页 News 正文

Meta releases the latest open-source big model Llama 3

日微牧
1245 0 0

On April 18th local time, Meta released its latest open-source large model Llama 3, providing pre trained and instruction fine-tuning versions of 8B and 70B.
According to Meta's official introduction, Llama 3 is trained on two customized 24K GPU clusters based on data exceeding 15T, which is 7 times larger than the dataset used by Llama 2 and 4 times more code. Additionally, Llama 3 supports 8K context length, which is twice the capacity of Llama 2. Moreover, Meta has also released parameter comparisons between two versions of Llama 3 and competitors such as Google Gemma, Google Gemini, Mistral, and Antioptic's Claude 3.
Meta CEO Zuckerberg introduced that Meta AI will be integrated into the search boxes at the top of Meta's major products WhatsApp, Instagram, Facebook, and Messenger, and will create a website called meta.ai to make it easier to use.
Meta Chief Scientist Yann LeCun stated that Llama will continue to release more versions in the coming months and will soon release research papers on Llama 3. Jim Fan, a senior scientist at Nvidia, believes that the possible release of Llama 3-400B and above versions in the future will become a "watershed", and the open source community will be able to use GPT-4 level models.
CandyLake.com 系信息发布平台,仅提供信息存储空间服务。
声明:该文观点仅代表作者本人,本文不代表CandyLake.com立场,且不构成建议,请谨慎对待。
您需要登录后才可以回帖 登录 | 立即注册

本版积分规则

  • 【科技记者古尔曼:苹果计划于12月第一周发布iOS 18.2系统更新 带来更多人工智能功能】科技记者古尔曼透露,苹果计划于12月第一周发布iOS 18.2系统更新。iOS 18.2将为iPhone 15 Pro机型和所有iPhone 16机型带来更多 ...
    cristianna
    昨天 17:32
    支持
    反对
    回复
    收藏
  •   为期超七周的大罢工终于落下帷幕。   当地时间11月4日,波音美国西海岸工厂工人们就改进后的合同提案投票。   随后,代表着波音超过33000名西雅图地区机械师的IAM工会经表决,以59%的同意票决定接纳波音提 ...
    cristianna
    2 小时前
    支持
    反对
    回复
    收藏
  •   近日,爱立信中国区总裁方迎在接受《经济参考报》记者采访时表示,5G技术在全球范围内得到了迅速发展,但面临商业潜力未能充分挖掘、网络运营难度较以往更高两大挑战。因此,运营商在继续5G网络部署的同时,应关 ...
    blueskybb
    昨天 15:05
    支持
    反对
    回复
    收藏
  •   “新四化”的时代浪潮下,新能源汽车行业百家争鸣。伴随着自主品牌不断崛起,合资品牌当下的生存状况备受外界关注,如何打好电动化时代的突围战,成为合资品牌的新课题。   作为国内合资车企的代表之一,上汽 ...
    mbgg2797
    5 小时前
    支持
    反对
    回复
    收藏
日微牧 新手上路
  • 粉丝

    0

  • 关注

    0

  • 主题

    4