On April 16, Robin Lee, the founder, chairman and CEO of Baidu, said at the Create 2024 Baidu AI Developers Conference that with the most powerful basic model Wenxin 4.0, we can tailor smaller models suitable for various scenarios based on needs, taking into account effects, speed, reasoning costs and other considerations, and support fine-tuning and post pre-trrain (a pre training method).
Compared with the model directly transferred from the open source model, Robin Lee said that the model cut through dimension reduction has better effect in the same size and lower cost in the same effect. He also believes, "So open source models will become increasingly outdated."