FlashHead Efficient Drop-In Replacement for the Classification Head in Language Model Inference. https://github.com/embedl/flash-head embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9 embedl/Qwen3-1.7B-FlashHead-W4A16 2B • Updated May 19 • 83 • 3 embedl/gemma-3-270m-it-FlashHead 0.3B • Updated May 19 • 198 • 3 embedl/Qwen3-0.6B-FlashHead 0.6B • Updated May 19 • 263 • 4
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9
Cosmos-Reason2 nvidia/Cosmos-Reason2 multi-modal reasoning models optimized by Embedl. embedl/Cosmos-Reason2-2B-W4A16-Edge2 Image-Text-to-Text • 2B • Updated May 19 • 267 • 13 embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9 embedl/Cosmos-Reason2-2B-NVFP4A16 Image-Text-to-Text • 2B • Updated May 19 • 2 • 1 embedl/Cosmos-Reason2-2B-W4A16 Image-Text-to-Text • 2B • Updated May 19 • 1.33k • 11
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9
NVIDIA Jetson Orin Nano Ultra-efficient model variants optimized for Jetson Orin Nano. Designed for constrained edge environments requiring low memory footprint. embedl/Cosmos-Reason2-2B-W4A16-Edge2 Image-Text-to-Text • 2B • Updated May 19 • 267 • 13 embedl/Cosmos-Reason2-2B-W4A16 Image-Text-to-Text • 2B • Updated May 19 • 1.33k • 11 embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9 Running 7 Edge Inference Benchmarks 🚀 7 On-Device benchmarks across devices and models.
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9
NVIDIA Jetson AGX Thor Models validated and performance-optimized for NVIDIA Jetson AGX Thor. Tailored for high-performance edge AI workloads. embedl/Cosmos-Reason2-2B-NVFP4A16 Image-Text-to-Text • 2B • Updated May 19 • 2 • 1 embedl/Cosmos-Reason2-2B-W4A16-Edge2 Image-Text-to-Text • 2B • Updated May 19 • 267 • 13 embedl/Cosmos-Reason2-2B-W4A16 Image-Text-to-Text • 2B • Updated May 19 • 1.33k • 11 embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9
EdgeN Quantization strategy where most weights are converted to INT4, activations remain in FP16, and sensitive layers are preserved in FP16. embedl/Cosmos-Reason2-2B-W4A16-Edge2 Image-Text-to-Text • 2B • Updated May 19 • 267 • 13 embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9 Running 7 Edge Inference Benchmarks 🚀 7 On-Device benchmarks across devices and models.
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9
Qwen3.5 Qwen/Qwen3.5 variants optimized by embedl. embedl/Qwen3.5-0.8B-FlashHead Image-Text-to-Text • 0.9B • Updated May 19 • 67 • 1 embedl/Qwen3.5-2B-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 2 embedl/Qwen3.5-4B-FlashHead Image-Text-to-Text • 5B • Updated May 19 • 9 • 2 embedl/Qwen3.5-9B-FlashHead Image-Text-to-Text • 10B • Updated May 19 • 2
NVIDIA Jetson AGX Orin Models optimized and bench-marked for NVIDIA Jetson AGX Orin. Memory-efficient and latency-optimized variants designed for real-time edge inference. embedl/Cosmos-Reason2-2B-W4A16-Edge2 Image-Text-to-Text • 2B • Updated May 19 • 267 • 13 embedl/Cosmos-Reason2-2B-W4A16 Image-Text-to-Text • 2B • Updated May 19 • 1.33k • 11 embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9 embedl/Qwen3.5-0.8B-FlashHead Image-Text-to-Text • 0.9B • Updated May 19 • 67 • 1
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9
FlashHead Efficient Drop-In Replacement for the Classification Head in Language Model Inference. https://github.com/embedl/flash-head embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9 embedl/Qwen3-1.7B-FlashHead-W4A16 2B • Updated May 19 • 83 • 3 embedl/gemma-3-270m-it-FlashHead 0.3B • Updated May 19 • 198 • 3 embedl/Qwen3-0.6B-FlashHead 0.6B • Updated May 19 • 263 • 4
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9
EdgeN Quantization strategy where most weights are converted to INT4, activations remain in FP16, and sensitive layers are preserved in FP16. embedl/Cosmos-Reason2-2B-W4A16-Edge2 Image-Text-to-Text • 2B • Updated May 19 • 267 • 13 embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9 Running 7 Edge Inference Benchmarks 🚀 7 On-Device benchmarks across devices and models.
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9
Cosmos-Reason2 nvidia/Cosmos-Reason2 multi-modal reasoning models optimized by Embedl. embedl/Cosmos-Reason2-2B-W4A16-Edge2 Image-Text-to-Text • 2B • Updated May 19 • 267 • 13 embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9 embedl/Cosmos-Reason2-2B-NVFP4A16 Image-Text-to-Text • 2B • Updated May 19 • 2 • 1 embedl/Cosmos-Reason2-2B-W4A16 Image-Text-to-Text • 2B • Updated May 19 • 1.33k • 11
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9
Qwen3.5 Qwen/Qwen3.5 variants optimized by embedl. embedl/Qwen3.5-0.8B-FlashHead Image-Text-to-Text • 0.9B • Updated May 19 • 67 • 1 embedl/Qwen3.5-2B-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 2 embedl/Qwen3.5-4B-FlashHead Image-Text-to-Text • 5B • Updated May 19 • 9 • 2 embedl/Qwen3.5-9B-FlashHead Image-Text-to-Text • 10B • Updated May 19 • 2
NVIDIA Jetson Orin Nano Ultra-efficient model variants optimized for Jetson Orin Nano. Designed for constrained edge environments requiring low memory footprint. embedl/Cosmos-Reason2-2B-W4A16-Edge2 Image-Text-to-Text • 2B • Updated May 19 • 267 • 13 embedl/Cosmos-Reason2-2B-W4A16 Image-Text-to-Text • 2B • Updated May 19 • 1.33k • 11 embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9 Running 7 Edge Inference Benchmarks 🚀 7 On-Device benchmarks across devices and models.
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9
NVIDIA Jetson AGX Orin Models optimized and bench-marked for NVIDIA Jetson AGX Orin. Memory-efficient and latency-optimized variants designed for real-time edge inference. embedl/Cosmos-Reason2-2B-W4A16-Edge2 Image-Text-to-Text • 2B • Updated May 19 • 267 • 13 embedl/Cosmos-Reason2-2B-W4A16 Image-Text-to-Text • 2B • Updated May 19 • 1.33k • 11 embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9 embedl/Qwen3.5-0.8B-FlashHead Image-Text-to-Text • 0.9B • Updated May 19 • 67 • 1
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9
NVIDIA Jetson AGX Thor Models validated and performance-optimized for NVIDIA Jetson AGX Thor. Tailored for high-performance edge AI workloads. embedl/Cosmos-Reason2-2B-NVFP4A16 Image-Text-to-Text • 2B • Updated May 19 • 2 • 1 embedl/Cosmos-Reason2-2B-W4A16-Edge2 Image-Text-to-Text • 2B • Updated May 19 • 267 • 13 embedl/Cosmos-Reason2-2B-W4A16 Image-Text-to-Text • 2B • Updated May 19 • 1.33k • 11 embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9
embedl/Cosmos-Reason2-2B-W4A16-Edge2-FlashHead Image-Text-to-Text • 2B • Updated May 19 • 1.18k • 9