Baidu open-sources ERNIE 4.5 series models, including multimodal MoE architecture

news image
Baidu has officially open-sourced its ERNIE 4.5 series, releasing 10 models on Hugging Face, GitHub and its own PaddlePaddle ecosystem. The lineup includes large-scale MoE (mixture of experts) models with activated parameter sizes of 47 billion and 3 billion (total parameters up to 424 billion), plus smaller dense models at 0.3 billion parameters…
阅读更多(Read More)

作者 gocpmall