Adam Optimizer Causes Privileged Basis in Transformer LM Residual Stream

submitted by /u/ellnorrisjerry
[link] [comments]