ByteDance’s Doubao Large Model team yesterday introduced UltraMem, a new architecture designed to address the high memory access issues found during inference in Mixture of Experts (MoE) models. UltraMem boosts inference speed by two to six times and can reduce inference costs by up to 83%…
阅读更多（Read More）
ByteDance unveils UltraMem architecture to reduce large model inference costs by up to 83%
作者gocpmall
3 月 13, 2025