Zhenyu Zhang

Zhenyu Zhang on Hugging Face Daily Papers: 7 papers, 1 in the top 3 of their day, 314 upvotes.

1. Stable-SPAM: How to Train in 4-Bit More Stably than 16-Bit Adam 16 upvotes, #11 of 2025-02-25
2. Mask-Enhanced Autoregressive Prediction: Pay Less Attention to Learn More 9 upvotes, #16 of 2025-02-12
3. APOLLO: SGD-like Memory, AdamW-level Performance 36 upvotes, #5 of 2024-12-09
4. From GaLore to WeLore: How Low-Rank Weights Non-uniformly Emerge from Low-Rank Gradients 6 upvotes, #13 of 2024-07-17
5. Q-GaLore: Quantized GaLore with INT4 Projection and Layer-Adaptive Low-Rank Gradients 28 upvotes, #4 of 2024-07-12
6. GaLore: Memory-Efficient LLM Training by Gradient Low-Rank Projection 150 upvotes, #1 of 2024-03-07
7. H_2O: Heavy-Hitter Oracle for Efficient Generative Inference of Large Language Models 14 upvotes, #5 of 2023-06-27

Data: hysts-bot-data/daily-papers-stats and the Daily Papers API. Open data: tardellirs/paper-pulse-data. Sister project: Model Pulse, the download history of every model on the Hub.