---
language:
- en
license: apache-2.0
base_model: mistralai/Mistral-7B-v0.3
tags:
- philosophy
- socratic
- gguf
- unsloth
- quantized
- reasoning
metrics:
- wisdom
library_name: gguf
---

# SocratesAI (GGUF Edition)
**The Digital Gadfly | High-Precision Philosophical Reasoning | Mobile-Ready**

> "I cannot teach anybody anything. I can only make them think." — SocratesAI

### Project Overview
**SocratesAI** is a fine-tuned version of Mistral-7B-v0.3, engineered to move beyond standard LLM "assistant" behavior. Instead of providing direct answers, this model utilizes the **Socratic Method** to challenge assumptions, expose contradictions, and guide the user toward their own insights.

This repository contains the **GGUF** version, optimized for local execution on laptops, smartphones, and edge devices.

### GGUF Specifications
- **Format:** GGUF (Llama.cpp compatible)
- **Quantization:** `Q4_K_M` (Optimal balance of intelligence and size)
- **Base Architecture:** Mistral-7B-v0.3
- **Optimized via:** Unsloth (2x faster inference, lower VRAM footprint)

### Persona & Capabilities
Unlike standard chatbots, SocratesAI is:
1. **Inquisitive:** It asks more questions than it answers.
2. **Ironical:** It uses gentle irony to highlight logical fallacies.
3. **Persistent:** It encourages deep critical thinking rather than shallow consensus.

### Local Execution
To run Socrates locally using `llama.cpp`:

```bash
./main -m SocratesAI-Q4_K_M.gguf -n 512 --prompt "User: What is justice? \nSocratesAI:"