Xuan Tang, second-year PhD student at The University of Hong Kong, researching learning theory and LLM optimization. https://doodlext.github.io/ https://doodlext.github.io/blog/rethinking-weight-decay/ https://doodlext.github.io/blog/rethinking-weight-decay/ From ordinary weight decay and optimizer evolution to spectral-power decay: exact linear theory, Transformer spectra, and controlled experiments that separate geometric change from training gains. Mon, 09 Nov 2026 14:05:13 GMT