---
license: apache-2.0
base_model: nvidia/Nemotron-3-4B-Base
library_name: peft
pipeline_tag: text-generation
tags:
  - grpo
  - lora
  - transformers
  - trl
  - interview
  - lex-fridman
---

# Lex Fridman Interviewer — GRPO v12 LoRA Adapter

Fine-tuned Nemotron-3-Nano-4B to ask Lex Fridman-style interview questions.

## Training
1. **LoRA v1** (r=64, LR=2e-4, 1 epoch, 4,772 pairs) → score 0.733  
2. **GRPO v12** (reward_v12, 200 steps from LoRA v1) → score **0.760**

## Eval (functional judge: on_topic × uses_guest × probing)

| Model | Score | uses_guest | probing |
|-------|-------|------------|---------|
| Base | 0.653 | 48% | 84% |
| LoRA v1 | 0.733 | 56% | 92% |
| **This model** | **0.760** | **60%** | **96%** |

## Reward (reward_v12)
`uses_guest_logit^0.67 × probing_logit^0.33 + lexical_bonus` — Qwen3.5-4B judges, continuous logits.