Text Generation
Transformers
Safetensors
GGUF
English
qwen2
claim-extraction
fact-checking
misinformation
contradiction-detection
sarcasm-detection
json
grammar-constrained
qlora
unsloth
conversational
text-generation-inference
Instructions to use Luimas/claim-extractor-detective-qwen3b with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- Transformers
How to use Luimas/claim-extractor-detective-qwen3b with Transformers:
# Use a pipeline as a high-level helper from transformers import pipeline pipe = pipeline("text-generation", model="Luimas/claim-extractor-detective-qwen3b") messages = [ {"role": "user", "content": "Who are you?"}, ] pipe(messages)# Load model directly from transformers import AutoTokenizer, AutoModelForCausalLM tokenizer = AutoTokenizer.from_pretrained("Luimas/claim-extractor-detective-qwen3b") model = AutoModelForCausalLM.from_pretrained("Luimas/claim-extractor-detective-qwen3b", device_map="auto") messages = [ {"role": "user", "content": "Who are you?"}, ] inputs = tokenizer.apply_chat_template( messages, add_generation_prompt=True, tokenize=True, return_dict=True, return_tensors="pt", ).to(model.device) outputs = model.generate(**inputs, max_new_tokens=40) print(tokenizer.decode(outputs[0][inputs["input_ids"].shape[-1]:])) - Notebooks
- Google Colab
- Kaggle
- Local Apps Settings
- llama.cpp
How to use Luimas/claim-extractor-detective-qwen3b with llama.cpp:
Install (macOS, Linux)
curl -LsSf https://llama.app/install.sh | sh # Start a local OpenAI-compatible server with a web UI: llama serve -hf Luimas/claim-extractor-detective-qwen3b:Q4_K_M # Run inference directly in the terminal: llama cli -hf Luimas/claim-extractor-detective-qwen3b:Q4_K_M
Install from WinGet (Windows)
winget install llama.cpp # Start a local OpenAI-compatible server with a web UI: llama serve -hf Luimas/claim-extractor-detective-qwen3b:Q4_K_M # Run inference directly in the terminal: llama cli -hf Luimas/claim-extractor-detective-qwen3b:Q4_K_M
Use pre-built binary
# Download pre-built binary from: # https://github.com/ggerganov/llama.cpp/releases # Start a local OpenAI-compatible server with a web UI: ./llama-server -hf Luimas/claim-extractor-detective-qwen3b:Q4_K_M # Run inference directly in the terminal: ./llama-cli -hf Luimas/claim-extractor-detective-qwen3b:Q4_K_M
Build from source code
git clone https://github.com/ggerganov/llama.cpp.git cd llama.cpp cmake -B build cmake --build build -j --target llama-server llama-cli # Start a local OpenAI-compatible server with a web UI: ./build/bin/llama-server -hf Luimas/claim-extractor-detective-qwen3b:Q4_K_M # Run inference directly in the terminal: ./build/bin/llama-cli -hf Luimas/claim-extractor-detective-qwen3b:Q4_K_M
Use Docker
docker model run hf.co/Luimas/claim-extractor-detective-qwen3b:Q4_K_M
- LM Studio
- Jan
- vLLM
How to use Luimas/claim-extractor-detective-qwen3b with vLLM:
Install from pip and serve model
# Install vLLM from pip: pip install vllm # Start the vLLM server: vllm serve "Luimas/claim-extractor-detective-qwen3b" # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:8000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Luimas/claim-extractor-detective-qwen3b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker
docker model run hf.co/Luimas/claim-extractor-detective-qwen3b:Q4_K_M
- SGLang
How to use Luimas/claim-extractor-detective-qwen3b with SGLang:
Install from pip and serve model
# Install SGLang from pip: pip install sglang # Start the SGLang server: python3 -m sglang.launch_server \ --model-path "Luimas/claim-extractor-detective-qwen3b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Luimas/claim-extractor-detective-qwen3b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }'Use Docker images
docker run --gpus all \ --shm-size 32g \ -p 30000:30000 \ -v ~/.cache/huggingface:/root/.cache/huggingface \ --env "HF_TOKEN=<secret>" \ --ipc=host \ lmsysorg/sglang:latest \ python3 -m sglang.launch_server \ --model-path "Luimas/claim-extractor-detective-qwen3b" \ --host 0.0.0.0 \ --port 30000 # Call the server using curl (OpenAI-compatible API): curl -X POST "http://localhost:30000/v1/chat/completions" \ -H "Content-Type: application/json" \ --data '{ "model": "Luimas/claim-extractor-detective-qwen3b", "messages": [ { "role": "user", "content": "What is the capital of France?" } ] }' - Ollama
How to use Luimas/claim-extractor-detective-qwen3b with Ollama:
ollama run hf.co/Luimas/claim-extractor-detective-qwen3b:Q4_K_M
- Unsloth Studio
How to use Luimas/claim-extractor-detective-qwen3b with Unsloth Studio:
Install Unsloth Studio (macOS, Linux, WSL)
curl -fsSL https://unsloth.ai/install.sh | sh # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Luimas/claim-extractor-detective-qwen3b to start chatting
Install Unsloth Studio (Windows)
irm https://unsloth.ai/install.ps1 | iex # Run unsloth studio unsloth studio -H 0.0.0.0 -p 8888 # Then open http://localhost:8888 in your browser # Search for Luimas/claim-extractor-detective-qwen3b to start chatting
Using HuggingFace Spaces for Unsloth
# No setup required # Open https://huggingface.co/spaces/unsloth/studio in your browser # Search for Luimas/claim-extractor-detective-qwen3b to start chatting
- Pi
How to use Luimas/claim-extractor-detective-qwen3b with Pi:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Luimas/claim-extractor-detective-qwen3b:Q4_K_M
Configure the model in Pi
# Install Pi: npm install -g @mariozechner/pi-coding-agent # Add to ~/.pi/agent/models.json: { "providers": { "llama-cpp": { "baseUrl": "http://localhost:8080/v1", "api": "openai-completions", "apiKey": "none", "models": [ { "id": "Luimas/claim-extractor-detective-qwen3b:Q4_K_M" } ] } } }Run Pi
# Start Pi in your project directory: pi
- Docker Model Runner
How to use Luimas/claim-extractor-detective-qwen3b with Docker Model Runner:
docker model run hf.co/Luimas/claim-extractor-detective-qwen3b:Q4_K_M
- Lemonade
How to use Luimas/claim-extractor-detective-qwen3b with Lemonade:
Pull the model
# Download Lemonade from https://lemonade-server.ai/ lemonade pull Luimas/claim-extractor-detective-qwen3b:Q4_K_M
Run and chat with the model
lemonade run user.claim-extractor-detective-qwen3b-Q4_K_M
List all available models
lemonade list
- Hermes Agent
How to use Luimas/claim-extractor-detective-qwen3b with Hermes Agent:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Luimas/claim-extractor-detective-qwen3b:Q4_K_M
Configure Hermes
# Install Hermes: curl -fsSL https://hermes-agent.nousresearch.com/install.sh | bash hermes setup # Point Hermes at the local server: hermes config set model.provider custom hermes config set model.base_url http://127.0.0.1:8080/v1 hermes config set model.default Luimas/claim-extractor-detective-qwen3b:Q4_K_M
Run Hermes
hermes
- Atomic Chat
- OpenClaw
How to use Luimas/claim-extractor-detective-qwen3b with OpenClaw:
Start the llama.cpp server
# Install llama.cpp: brew install llama.cpp # Start a local OpenAI-compatible server: llama serve -hf Luimas/claim-extractor-detective-qwen3b:Q4_K_M
Configure OpenClaw
# Install OpenClaw: npm install -g openclaw@latest # Register the local server and set it as the default model: openclaw onboard --non-interactive --mode local \ --auth-choice custom-api-key \ --custom-base-url http://127.0.0.1:8080/v1 \ --custom-model-id "Luimas/claim-extractor-detective-qwen3b:Q4_K_M" \ --custom-provider-id llama-cpp \ --custom-compatibility openai \ --custom-text-input \ --accept-risk \ --skip-health
Run OpenClaw
openclaw agent --local --agent main --message "Hello from Hugging Face"
| You are an expert claim-extraction and fact-verification engine for rumor and misinformation detection. Read the English TEXT (it may be long-form news, noisy, bulleted, sarcastic, adversarial, or use narrative framing) and understand what is actually asserted, including implicit, paraphrased, attributed, and indirect claims. Decompose compound sentences into separate atomic claims. Distinguish fact from opinion, speculation, rhetoric, and framing. Detect when two claims contradict each other. CRITICAL - sarcasm and irony: when a statement is sarcastic or ironic the speaker means the OPPOSITE of the literal words, so DO NOT take it at face value. Restate the claim as the speaker's ACTUAL intended meaning (e.g. sarcastic praise 'the engineers really outdid themselves' about a product that got worse becomes 'the user thinks the engineers made the product worse'), set that claim's claim_type to 'opinion' and its stance to 'ironic', and add a 'tension' contradiction linking the ironic statement to the factual claim it conflicts with. Keep EVERY claim brief and on point: a concise, self-contained paraphrase of about 5-15 words that captures the assertion - NEVER a verbatim copy of the sentence (the verbatim text belongs only in evidence_span). For EVERY claim, also act like a detective / investigative fact-checker and generate concrete verification questions a human would need to confirm or refute it, covering source/authority, available evidence, numbers/methodology, timeline, location, actors, causation-vs-correlation, independent corroboration, contradictions, and missing context. Return ONLY a JSON object (no prose, no markdown) with EXACTLY this schema: | |
| {"summary": "<1-3 sentence neutral summary>", "publication_date": "<ISO date or datetime if present in the text, else null>", "keywords": ["<3-12 salient terms or names>"], "claims": [{"id": <int from 0>, "claim": "<brief self-contained paraphrase, ~5-15 words>", "claim_type": "fact|statistic|opinion|prediction|speculation|rhetoric|other", "category": "<short topic, e.g. politics, health, economy, science>", "importance": "high|medium|low", "stance": "asserted|denied|hedged|attributed|ironic", "sentiment": "positive|negative|neutral|mixed", "evidence_span": "<verbatim substring from TEXT supporting this claim>", "confidence": <0..1>, "verification_questions": ["<3-6 specific investigative questions to verify this claim>"]}], "contradictions": [{"claim_a": <id>, "claim_b": <id>, "relation": "contradiction|tension", "explanation": "<short why>"}]} | |
| Rules: extract 1-15 atomic claims; ids start at 0 and increase; NEVER output two identical claims; each claim must be a BRIEF paraphrase (~5-15 words), never a copied sentence; for sarcasm/irony restate the real meaning, set stance to 'ironic', and add a 'tension' contradiction; evidence_span MUST be copied verbatim from the TEXT; give 3-6 specific verification_questions per claim (prefer concrete questions over generic boilerplate); use ONLY the allowed enum values; list a contradiction only when two extracted claims genuinely conflict, else []. For EVERY claim set the "sentiment" field to the speaker attitude toward the claim (positive/negative/neutral/mixed); for sarcasm/irony use the speaker REAL intended sentiment, not the literal words. Flag numeric/statistical inconsistencies (a rate, total, or percentage that cannot be reconciled) as a contradiction or tension, and make each contradiction "explanation" a concrete one-line reason for the actual conflict, not boilerplate. Output valid JSON only. | |
| TEXT: | |