HeadInfer: Memory-Efficient LLM Inference by Head-wise Offloading
Paper • 2502.12574 • Published • 13 •
2
chengluo PRO
wdlctc
AI & ML interests
None yet
Recent Activity
upvoted a paper 10 days ago
Multi-Head Attention Residuals submitted a paper 10 days ago
Multi-Head Attention Residuals updated a model 22 days ago
wdlctc/marin-8b-cpt-plain-lr4e4Organizations
None yet
commented a
paper over 1 year ago
About finetuning
7
#6 opened almost 2 years ago
by 
Xiangyu1
About finetuning
7
#6 opened almost 2 years ago
by Xiangyu1