Your LR Schedule May Not Be Principled: Effective Learning Rate Scheduling in Weight-Normalized Training
Paper • 2610.40362 • Published • 8
Montgomery
MMMicheil
AI & ML interests
None yet
Recent Activity
upvoted a paper about 7 hours ago
Your LR Schedule May Not Be Principled: Effective Learning Rate Scheduling in Weight-Normalized Training upvoted a paper 12 days ago
LimiX-2: A Contextual Mechanism Network Towards General Structured-Data IntelligenceOrganizations
None yet
upvoted a paper about 7 hours ago
upvoted 9
papers 12 days ago
Embeddings Are Overpriced? A Frozen 16 MB Vocabulary for Small and Ternary Language Models
Paper • 2610.22428 • Published • 17
LimiX-2: A Contextual Mechanism Network Towards General Structured-Data Intelligence
Paper • 2609.17488 • Published • 286
SpecMRL: Redesign Matryoshka Representation Learning within Parametric Spectrum
Paper • 2610.26824 • Published • 36
RSIPO: Recursive Self-Improving Policy Optimization for Agentic Reinforcement Learning via Skill-Policy Co-Evolution
Paper • 2610.15772 • Published • 8
ClawLoop: Self-Improving Agents via Harness-Native Training Loop
Paper • 2610.14118 • Published • 34
TimeRSI: Towards Self-Improved Agentic Deployment for Time-Series Foundation Models
Paper • 2610.19725 • Published • 5
Terminal-RSI: Recursive Self-Improving Terminal Agents via Recursive Self-Rewrite and Policy-Refine
Paper • 2610.22192 • Published • 38
Self-Evolving Agent Harness
Paper • 2610.18813 • Published • 78
DiscoveryRSI: Recursively Learning to Discover Valuable Hypotheses
Paper • 2610.23839 • Published • 20
upvoted a paper about 1 month ago
upvoted 4
papers 5 months ago
ICA Lens: Interpreting Language Models Without Training Another Dictionary
Paper • 2606.11722 • Published • 11
Beyond Scalar Rewards by Internalizing Reasoning into Score Distributions
Paper • 2606.09076 • Published • 62
Redesign Mixture-of-Experts Routers with Manifold Power Iteration
Paper • 2606.12397 • Published • 50
Your UnEmbedding Matrix is Secretly a Feature Lens for Text Embeddings
Paper • 2606.07502 • Published • 55
upvoted a paper 9 months ago