Huihui-Qwen3.5-9B-abliterated-TIES-Hemlock-SFT

Training Configuration

Parameter	Value
Training Mode	SFT
Base Model	`nbeerbower/Huihui-Qwen3.5-9B-abliterated-TIES`
Learning Rate	9e-05
Epochs	1
Batch Size	1
Gradient Accumulation	32
Effective Batch Size	32
Max Sequence Length	2048
Optimizer	paged_adamw_8bit
LR Scheduler	cosine
Warmup Ratio	0.05
Weight Decay	0.01
Max Grad Norm	0.25
Seed	42
LoRA Rank (r)	128
LoRA Alpha	64
LoRA Dropout	0.05
Target Modules	k_proj, o_proj, q_proj, v_proj, down_proj, gate_proj, up_proj
Quantization	4-bit (NF4)
GPU	NVIDIA RTX A6000