Hanshi

Hanshi on Hugging Face Daily Papers: 3 papers, 0 in the top 3 of their day, 38 upvotes.

1. ShadowKV: KV Cache in Shadows for High-Throughput Long-Context LLM Inference 9 upvotes, #8 of 2024-10-30
2. Fast Best-of-N Decoding via Speculative Rejection 8 upvotes, #11 of 2024-10-29
3. TriForce: Lossless Acceleration of Long Sequence Generation with Hierarchical Speculative Decoding 14 upvotes, #7 of 2024-04-19

Data: hysts-bot-data/daily-papers-stats and the Daily Papers API. Open data: tardellirs/paper-pulse-data. Sister project: Model Pulse, the download history of every model on the Hub.