Back to Home
AI on Medium··Industry Media

Why Stochastic Gradient Descent (SGD) is Outdated and How to Fix it with Kronecker Sequences

中文摘要

使用 Kronecker 序列替代 SGD 并通过优化 PyTorch 数据读取方式,可将深度学习训练成本降低一半。

English Summary

Replacing SGD with Kronecker Sequences can halve deep learning training costs by mathematically shifting how PyTorch reads data.

Original Excerpt

How a simple mathematical shift in the way PyTorch reads data can cut your Deep Learning training costs in half. Continue reading on Medium »