## CudaLLM: A Language Model for High-Performance CUDA Kernel Generation
### Model Description
cudaLLM-8B is a language model for generating high-performance and syntactically correct CUDA kernels. It is based on the Qwen3-8B model and has undergone a two-stage training process to master the complexities of parallel programming for GPUs.
**Performance on KernelBench:**
| | Bo1 | Bo2 | Bo4 | Bo8 | Bo16 |
|---------|-------|-----|-----|-----|------|
| Level-1 | 79.75 | 83 | 84 | 86 | 87 |
| Level-2 | 67.30 | 70 | 71 | 72 | 73 |
| Level-3 | 20.83 | 26 | 30 | 34 | 36 |
### Training Procedure
The model was trained using the verl library. The model was trained and evaluated on:
- SFT Dataset: A high-quality dataset of CUDA problem-solution pairs ([sft_cuda_llm_r1.parquet](https://huggingface.co/datasets/ByteDance-Seed/cudaLLM-data)), originally generated by DeepSeek R1, DeepSeel Coder-7B, and Qwen2-32B.
- RL Dataset: A refined dataset ([rl_cuda_llm_0424.parquet](h…
