Joe Rocca PRO

rocca's activity

• All
• Models
• Datasets
• Spaces
• Buckets
• Papers
• Collections
• Community
• Posts
• Upvotes
• Likes
• Articles

New activity in amd/DeepSeek-R1-0528-MXFP4-ASQ 6 months ago

Minimal working setup for SGLang (and vLLM?)

#2 opened 6 months ago by

rocca

New activity in rocca/chroma-nunchaku-test 9 months ago

Which model to be loaded?

11

#3 opened 9 months ago by

Skymid

New activity in rocca/chroma-nunchaku-test 11 months ago

FP4 quantization, INT4 crash on RTX 50XX

🔥 1

7

#2 opened 11 months ago by

Askd234

Any chance of creating a v30 version to hold over until real support?

👍 3

9

#1 opened 12 months ago by

Todokete

New activity in QuixiAI/DeepSeek-V3-0324-AWQ 11 months ago

Does FlashMLA support kv cache fp8 dtype and how to enable FlashMLA ?

10

#6 opened about 1 year ago by

CharlesLincoln

New activity in lodestones/Chroma about 1 year ago

Diffusers Roadmap?

👍 1

4

#5 opened about 1 year ago by

Impulse2000

New activity in ibm-ai-platform/llama-13b-accelerator almost 2 years ago

70B model?

5

#1 opened almost 2 years ago by

rocca

New activity in MaziyarPanahi/miqu-1-70b-sf-GPTQ almost 2 years ago

vllm can not inter this model (other 70b gptq model are ok)

15

#1 opened over 2 years ago by

tutu329

New activity in text-generation-inference/commandrplus-medusa about 2 years ago

Is `--speculate` needed for Medusa in TGI?

2

#1 opened about 2 years ago by

rocca

New activity in TheBloke/goliath-120b-GPTQ over 2 years ago

Double-hyphen in "gptq-3bit--1g-actorder_True" branch name is invalid according to TGI

1

#1 opened over 2 years ago by

rocca

New activity in rocca/lyra-v2-soundstream over 3 years ago

Conversion to ONNX

4

#1 opened over 3 years ago by

roseman

New activity in rocca/rwkv-4-pile-web over 3 years ago

Delete the outdated rwkv-4-pile-430m-webgl.onnx

1

#4 opened over 3 years ago by

AXKuhta

Upload rwkv-4-pile-430m-webgl.onnx

1

#3 opened over 3 years ago by

AXKuhta

Upload rwkv-4-pile-430m-webgl.onnx

1

#2 opened over 3 years ago by

AXKuhta

Upload rwkv-4-pile-169m-webgl.onnx

1

#1 opened over 3 years ago by

AXKuhta

New activity in rocca/openai-clip-js almost 4 years ago

This is really exciting

2

#1 opened almost 4 years ago by

victor