# qwen3-1.7b-ben-franklin-thinking-v6-1-ood-fixed-lora ## Summary Custom Benjamin Franklin LoRA adapter for Qwen3 1.7B 4-bit. ## Paths - Portfolio copy: `adapters/qwen3-1.7b-ben-franklin-thinking-v6-1-ood-fixed-lora` - Source: copied adapter artifact in `adapters/qwen3-1.7b-ben-franklin-thinking-v6-1-ood-fixed-lora` - Base model: `unsloth/Qwen3-1.7B-unsloth-bnb-4bit` ## Adapter details - Adapter directory size: 0.99 GB - adapter_model.safetensors: 133.0 MB - SHA256(adapter_model.safetensors): `7e3440142a1999e09b82a49d76d9c06238ae69695f766a388f9af36290612298` - LoRA rank: 32 - LoRA alpha: 64 - Target modules: `['v_proj', 'k_proj', 'q_proj', 'up_proj', 'gate_proj', 'down_proj', 'o_proj']` ## Strengths - Largest Benjamin Franklin LoRA family proven trainable on this RTX 3070 8GB machine. - Best base reasoning/coherence among the local Franklin adapters. - Good short-turn continuity in the coherence benchmark. ## Weaknesses / caveats - Qwen2.5 7B base is already highly steerable, so improvements over the prompted base are modest. - q/v-only LoRA is weak for implanting stubborn factual corrections. - Craven Street/Hewson factuality remains unreliable unless retrieval/prompt context is supplied. ## Data mix - franklin_qwen3_8b_chatml_answer_clean.jsonl: 2400 rows ## Performance Not benchmarked in the current coherence index. ## Memory / compute requirements Inference: RTX 3070 8GB works in 4-bit with the adapter; expect roughly 6-7GB VRAM. Training proven only with q_proj/v_proj, r=4 or r=8, max_seq_length=512, batch_size=1, gradient_accumulation=16; full-module LoRA is not recommended on 8GB. ## Possible project uses - Conversational Franklin persona in local apps. - A strong baseline for RAG-backed historical character demos. - Best starting point for further 7B experiments.