MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines
中文摘要
Meta推出内置NIC和通信卸载引擎的MTIA 300训练芯片，专为推荐模型优化，性能优于通用GPU。
English Summary
Meta's MTIA 300 training chip features built-in NICs and communication-offloading engines. Optimized for recommendation models, it outperforms general-purpose GPUs through specialized co-design.
MTIA 300 is the first of Meta’s family of in-house training and inference accelerators optimized for training ranking and recommendation models. We’re sharing how MTIA 300’s built-in NIC chiplets allow it to meet the communication needs associated with training recommendation models with superior performance over general-purpose GPUs. By co-designing MTIA’s communication library, HCCL, alongside the [...] Read More... The post MTIA 300: Meta’s First Training Chip with Built-in NICs and Communication-Offloading Engines appeared first on Engineering at Meta.