Why Parameter Count Is Not Model Complexity: An Introduction to Effective Dimension
中文摘要
本文介绍有效维度概念,解释为何参数量不等于模型复杂度,以及有效维度如何揭示模型的冗余、泛化和训练性。
English Summary
This article introduces effective dimension, explaining why parameter count fails to represent model complexity and how effective dimension reveals model redundancy, generalization, and trainability.
原文节选
What does effective dimension reveal about redundancy, generalization, and trainability that parameter count, loss, and accuracy do not?