YangWang92

yangwang92's activity

• All
• Models
• Datasets
• Spaces
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in VPTQ-community/Qwen2.5-32B-Instruct-v8-k65536-65536-woft 11 months ago

Use aphrodite-engine to infer this model error

5

#2 opened 11 months ago by

zanepoe

New activity in VPTQ-community/deepseek-r1_v_8_k_65536_mixed_mp4 11 months ago

Create README.md

#1 opened 11 months ago by

yangwang92

New activity in VPTQ-community/deepseek-r1_v_8_k_65536 11 months ago

Create README.md

#1 opened 11 months ago by

yangwang92

New activity in VPTQ-community/deepseek-r1_v_8_k_65536_256 11 months ago

Create README.md

#1 opened 11 months ago by

yangwang92

New activity in VPTQ-community/deepseek-r1_v_8_k_65536_256_mp4 11 months ago

Create README.md

#1 opened 11 months ago by

yangwang92

New activity in VPTQ-community/deepseek-r1_v8_k_65536_mp4 11 months ago

Create README.md

#1 opened 11 months ago by

yangwang92

New activity in nvidia/Llama-3.1-Nemotron-70B-Instruct-HF over 1 year ago

Will quantised version be available?

4

#9 opened over 1 year ago by

angerhang

How to inference it on a 40 GB A100 and 80 GB Ram of Colab PRO?

1

#17 opened over 1 year ago by

SadeghPouriyanZadeh

commented 2 papers over 1 year ago

VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models

Paper • 2409.17066 • Published Sep 25, 2024 • 28 •

4

VPTQ: Extreme Low-bit Vector Post-Training Quantization for Large Language Models

Paper • 2409.17066 • Published Sep 25, 2024 • 28 •

4

New activity in huggingface/HuggingDiscussions over 1 year ago

[FEEDBACK] Daily Papers

🔥 ❤️ 21

177

#32 opened over 1 year ago by

kramp