Sophia: Scalable Stochastic 2nd-Order Optimizer for Language Model Pre-Training

Published: April 7, 2024

abstract-business-code-270348

Article URL: https://arxiv.org/abs/2305.14342

Comments URL: https://news.ycombinator.com/item?id=39959228

Points: 1

# Comments: 0