FIELD_COVERAGE_DIFF.md

Field Coverage Diff: base vs sakhi

Date: 2026-04-17 09:53

The fine-tuned sakhi model matched the base model on 14/15 end-to-end tests with comparable latency (19.0s vs 18.7s avg). The base model extracted more raw fields on average (11 vs 2 unique extractions). The fine-tune translates Hindi symptom phrases into English schema labels (e.g., "दस्त" → "Diarrhea", "चक्कर आ रहे हैं" → "dizziness") and recovers two visit-type-specific fields the base model misses (anc_details.facility_or_home, visit_info.hbyc_visit_month). Base ships in the live pipeline for the single-test accuracy edge (15/15 vs 14/15); the fine-tune is registered as a schema-normalization alternative.

Summary

• Sakhi extracted fields base left null: 2
• Base extracted fields sakhi left null: 11
• Sakhi consistently normalized Hindi → English symptom labels in 5+ tests (see Differ sections)

Captures every form leaf path, filtering out fields already covered by the pass/fail harness (expected_form_checks + hallucination_traps).

ANC Preeclampsia — multi-danger

Sakhi extracted, base returned null (1):

• anc_details.facility_or_home = Home

Base extracted, sakhi returned null (1):

• pregnancy.gestational_weeks = 8

Differ (5):

• counseling_provided[0]: base=Advised to visit PHC immediately, sakhi=PHC जाने की सलाह
• symptoms_reported[0]: base=Headache, sakhi=सिरदर्द
• symptoms_reported[1]: base=Blurred vision, sakhi=आँखों के सामने धुंधला दिखना
• symptoms_reported[2]: base=Facial swelling, sakhi=चेहरे पर सूजन
• symptoms_reported[3]: base=Swelling in legs, sakhi=पैरों में सूजन

ANC Severe Anemia

Differ (3):

• counseling_provided[0]: base=Take Iron injection at PHC, sakhi=Take iron injection at PHC
• symptoms_reported[0]: base=Dizziness, sakhi=चक्कर आते हैं
• symptoms_reported[1]: base=Difficulty breathing, sakhi=साँस लेने में तकलीफ़ होती है

ANC Unlabeled ASR output

Base extracted, sakhi returned null (2):

• birth_preparedness.facility_identified = True
• counseling_provided[1] = Management of low hemoglobin

Differ (1):

• counseling_provided[0]: base=IFA usage (daily), sakhi=IFA रोज़ लेना

PNC Normal — day 7

Differ (3):

• infant_assessment.feeding_status: base=mixed_feeding, sakhi=exclusive_breastfeeding
• mother_assessment.general_condition: base=fine, sakhi=Fine
• symptoms_reported[0]: base=very little bleeding, sakhi=Bleeding (very little)

PNC Danger — newborn not feeding

Base extracted, sakhi returned null (2):

• symptoms_reported[3] = fever
• symptoms_reported[4] = lethargic

Differ (3):

• symptoms_reported[0]: base=sleeps a lot, sakhi=Excessive sleepiness
• symptoms_reported[1]: base=not drinking milk properly, sakhi=Poor feeding
• symptoms_reported[2]: base=12 hours without milk, sakhi=Fever

PNC Danger — postpartum bleeding

Differ (4):

• mother_assessment.general_condition: base=बहुत कमज़ोरी है, sakhi=Weakness, dizziness
• symptoms_reported[0]: base=बहुत ज़्यादा खून आ रहा है, sakhi=heavy bleeding
• symptoms_reported[1]: base=चक्कर आ रहे हैं, sakhi=dizziness
• symptoms_reported[2]: base=कमज़ोरी, sakhi=weakness

Delivery — home, LBW baby

Base extracted, sakhi returned null (4):

• required[0] = delivery
• required[1] = outcome
• required[2] = infant
• required[3] = symptoms_reported

Child Health — routine 9 months

Base extracted, sakhi returned null (1):

• growth_assessment.weight_for_age = normal

Child Health — diarrhea danger

Sakhi extracted, base returned null (1):

• visit_info.hbyc_visit_month = 12

Differ (5):

• counseling_provided[0]: base=तुरंत PHC जाना होगा, sakhi=Immediate visit to PHC
• feeding.diet_description: base=खाना-पीना बंद कर दिया है, sakhi=Stopped eating and drinking
• symptoms_reported[0]: base=दस्त, sakhi=Diarrhea
• symptoms_reported[1]: base=सुस्त, sakhi=Dehydration signs
• symptoms_reported[2]: base=आँखें धँसी हुई (Dehydration signs), sakhi=Lethargy

ANC Zero Findings — false positive trap

Base extracted, sakhi returned null (1):

• counseling_provided[0] = Call ASHA if any discomfort is felt