返回首页
AI on Medium··行业媒体

How much VRAM do you need to fine-tune an LLM? Between 12 GB and 120 GB, and the method decides

中文摘要

中文:微调LLM所需显存从12GB到120GB不等,具体取决于方法。

English Summary

English: Fine-tuning LLMs requires 12GB to 120GB of VRAM, depending on the method used.

原文节选

The honest answer to this question is a range, and the range is wide enough to be useless unless you know which end you are at. Continue reading on Medium »