bibkey: “thilaklittwinzhaisaremipaisssusskind2022slingshot” authors: “Vimal Thilak; Etai Littwin; Shuangfei Zhai; Omid Saremi; Roni Paiss; Joshua Susskind” year: 2022 title: “The Slingshot Mechanism: An Empirical Study of Adaptive Optimizers and the Grokking Phenomenon” doi: null claim: “With adaptive optimizers, grokking coincides with cyclic stable-unstable training transitions (slingshots) and can occur without explicit regularization.” strata_touched: [] license: “citation-only” triage: “anchor” url: “https://arxiv.org/abs/2206.04817”

The Slingshot Mechanism: An Empirical Study of Adaptive Optimizers and the Grokking Phenomenon

Verified locator

arXiv:2206.04817. Cited only as a report of delayed generalization outside the weight-decay, fixed-feature setting.

Declared identifiers: https://arxiv.org/abs/2206.04817.