huluhuluu/qwen3-1p7b-eagle3-sharegpt-vb128k
Text Generation • Updated
SpecForge Qwen3-1.7B EAGLE3 Draft Models
Selected public SpecForge EAGLE3 draft checkpoints for Qwen3-1.7B.
Note Full vb128k run; final checkpoint epoch_9_step_233900.
huluhuluu/qwen3-1p7b-eagle3-stage2-adapter-w4-epoch-7-step-187120
Text Generation • 0.1B • Updated • 199Note Stage2 adapter W4, bottleneck 256, final step 187120.
huluhuluu/qwen3-1p7b-eagle3-stage2-adapter-w4-scale1-epoch-5-step-120000
Text Generation • 0.1B • Updated • 198Note Stage2 adapter W4 scale1, bottleneck 256, step 120000.
huluhuluu/qwen3-1p7b-eagle3-stage2-adapter-w4-bn1024-lr3e-4-epoch-3-step-160000
Text Generation • 0.1B • Updated • 202Note Stage2 adapter W4, bottleneck 1024, lr 3e-4, step 160000.
huluhuluu/qwen3-1p7b-eagle3-stage2-adapter-w4-learnable-scale-fp16-bn1024-lr1e-4-epoch-7-step-187120
Text Generation • 0.1B • Updated • 207Note Stage2 adapter W4, FP16 learnable scale, bottleneck 1024, step 187120.
huluhuluu/qwen3-1p7b-eagle3-k2-sw128-sharegpt-epoch-7-step-175000
Text Generation • 0.2B • Updated • 206Note K2 sliding window 128, step 175000.
huluhuluu/qwen3-1p7b-eagle3-k2-sw256-mha-sharegpt-epoch-9-step-171560
Text Generation • 0.2B • Updated • 212Note K2 sliding window 256 MHA, step 171560.
huluhuluu/qwen3-1p7b-eagle3-k4-sw256-sharegpt-epoch-2-step-70000
Text Generation • 0.3B • Updated • 212Note K4 sliding window 256 partial checkpoint, step 70000.
huluhuluu/qwen3-1p7b-eagle3-k2-sw256-sharegpt-epoch-2-step-65000
Text Generation • 0.2B • Updated • 206Note K2 sliding window 256 early-stopped checkpoint, step 65000.