返回首页
AI on Medium··行业媒体

Multi Token Prediciton

中文摘要

多Token预测 (MTP) 是一种扩展了传统逐Token预测方法的训练技术。

English Summary

Multi-Token Prediction (MTP) is a training technique that extends traditional Next-Token Prediction.

原文节选

In this section, we will explore Multi-Token Prediction (MTP), a training technique that extends the traditional Next-Token Prediction… Continue reading on Medium »