bibkey: “rajamanoharan2024jumprelu” authors: “Senthooran Rajamanoharan; Tom Lieberum; Nicolas Sonnerat; Arthur Conmy; Vikrant Varma; Janos Kramar; Neel Nanda” year: 2024 title: “Jumping Ahead: Improving Reconstruction Fidelity with JumpReLU Sparse Autoencoders” doi: null claim: “JumpReLU sparse autoencoders use a thresholded activation with an l0-type penalty trained through straight-through estimators.” strata_touched: [] license: “citation-only” triage: “anchor” url: “https://arxiv.org/abs/2407.14435”

Jumping Ahead: Improving Reconstruction Fidelity with JumpReLU Sparse Autoencoders

Verified locator

arXiv:2407.14435. Used only for the definition of the JumpReLU objective.

Declared identifiers: https://arxiv.org/abs/2407.14435.