Spaces:
Running
Running
Upload 3 files
Browse files
skills/fact-checker/SKILL.md
ADDED
|
@@ -0,0 +1,328 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
name: fact-checker
|
| 3 |
+
description: Comprehensive fact-checking and verification system for analyzing text, articles, or webpage content for factual accuracy. Use when users ask to verify claims, fact-check articles, assess credibility of information, check sources, validate statements, or determine if something is true or false. Also use for requests to analyze misinformation, verify news articles, check social media claims, or assess the reliability of sources.
|
| 4 |
+
---
|
| 5 |
+
|
| 6 |
+
# Fact Checker
|
| 7 |
+
|
| 8 |
+
## Overview
|
| 9 |
+
|
| 10 |
+
Analyze text, articles, and webpage content for factual accuracy using rigorous verification methodology. Extract verifiable claims, cross-reference against trusted academic and authoritative sources, assess credibility, and provide comprehensive verification reports with supporting evidence.
|
| 11 |
+
|
| 12 |
+
## Fact-Checking Workflow
|
| 13 |
+
|
| 14 |
+
Follow these steps for thorough fact-checking:
|
| 15 |
+
|
| 16 |
+
1. **Claim Extraction** - Identify all verifiable factual claims
|
| 17 |
+
2. **Source Research** - Search trusted sources for verification
|
| 18 |
+
3. **Credibility Assessment** - Evaluate each claim with evidence
|
| 19 |
+
4. **Quality Rating** - Score sources using established criteria
|
| 20 |
+
5. **Report Generation** - Compile findings in structured format
|
| 21 |
+
|
| 22 |
+
## Step 1: Claim Extraction
|
| 23 |
+
|
| 24 |
+
Identify and list all factual claims that can be verified:
|
| 25 |
+
|
| 26 |
+
**Extract claims that are:**
|
| 27 |
+
- Specific and measurable (statistics, dates, quotes)
|
| 28 |
+
- Objectively verifiable (events, facts, scientific statements)
|
| 29 |
+
- Attributable to specific sources (when cited)
|
| 30 |
+
|
| 31 |
+
**Exclude:**
|
| 32 |
+
- Opinions and subjective judgments
|
| 33 |
+
- Future predictions (unless assessing past predictions)
|
| 34 |
+
- Vague or ambiguous statements
|
| 35 |
+
- Questions or rhetorical statements
|
| 36 |
+
|
| 37 |
+
**Format extracted claims as:**
|
| 38 |
+
```
|
| 39 |
+
Claim 1: [Specific factual statement]
|
| 40 |
+
Claim 2: [Specific factual statement]
|
| 41 |
+
Claim 3: [Specific factual statement]
|
| 42 |
+
```
|
| 43 |
+
|
| 44 |
+
## Step 2: Source Research
|
| 45 |
+
|
| 46 |
+
For each claim, search trusted sources systematically:
|
| 47 |
+
|
| 48 |
+
**Search priority order:**
|
| 49 |
+
1. **Academic sources first** - Use web_search with terms like "site:scholar.google.com [claim]", "site:pubmed.ncbi.nlm.nih.gov [claim]", or "[claim] peer reviewed study"
|
| 50 |
+
2. **Government databases** - For statistics and official data, search "site:gov [claim]" or specific databases (census.gov, cdc.gov, etc.)
|
| 51 |
+
3. **Fact-checking organizations** - Search "site:snopes.com [claim]", "site:politifact.com [claim]", "site:factcheck.org [claim]"
|
| 52 |
+
4. **Reputable news sources** - Cross-reference with established news organizations
|
| 53 |
+
5. **Domain-specific experts** - For specialized topics, seek expert sources
|
| 54 |
+
|
| 55 |
+
**Search strategies:**
|
| 56 |
+
- Use web_search tool with specific keywords from the claim
|
| 57 |
+
- Search for both supporting and contradictory evidence
|
| 58 |
+
- Use web_fetch to retrieve full content of promising sources
|
| 59 |
+
- Check multiple independent sources for corroboration
|
| 60 |
+
- Look for original/primary sources when possible
|
| 61 |
+
|
| 62 |
+
**For each claim, aim to find:**
|
| 63 |
+
- At least 2-3 independent sources
|
| 64 |
+
- Primary sources when available
|
| 65 |
+
- Recent sources (especially for current events)
|
| 66 |
+
- Sources with documented methodology
|
| 67 |
+
|
| 68 |
+
## Step 3: Credibility Assessment
|
| 69 |
+
|
| 70 |
+
For each claim, provide a detailed assessment:
|
| 71 |
+
|
| 72 |
+
### Verification Status
|
| 73 |
+
|
| 74 |
+
Assign one of these statuses (see references/verification_methodology.md for detailed criteria):
|
| 75 |
+
|
| 76 |
+
**TRUE:** Supported by reliable evidence from multiple sources with no significant contradictions
|
| 77 |
+
|
| 78 |
+
**FALSE:** Contradicted by reliable evidence; demonstrably incorrect
|
| 79 |
+
|
| 80 |
+
**PARTIALLY TRUE:** Contains elements of truth but incomplete, misleading, or lacks crucial context
|
| 81 |
+
|
| 82 |
+
**UNVERIFIED:** Insufficient evidence to confirm or deny; conflicting sources without resolution
|
| 83 |
+
|
| 84 |
+
**OPINION/SUBJECTIVE:** Matter of opinion or judgment rather than verifiable fact
|
| 85 |
+
|
| 86 |
+
### Confidence Level
|
| 87 |
+
|
| 88 |
+
Rate confidence based on evidence quality:
|
| 89 |
+
|
| 90 |
+
**HIGH (85-100%):** Multiple independent reliable sources confirm; primary sources available; peer-reviewed research; expert consensus
|
| 91 |
+
|
| 92 |
+
**MEDIUM (60-84%):** Reliable secondary sources; some corroboration; expert opinion without full consensus; indirect evidence
|
| 93 |
+
|
| 94 |
+
**LOW (40-59%):** Limited sources; moderate credibility; circumstantial evidence; conflicting information exists
|
| 95 |
+
|
| 96 |
+
### Supporting Evidence
|
| 97 |
+
|
| 98 |
+
For each claim, document:
|
| 99 |
+
- **Source citations** with web_fetch URLs when available
|
| 100 |
+
- **Key evidence** from each source (paraphrased, never quoted directly)
|
| 101 |
+
- **Source type** (peer-reviewed study, government data, news report, etc.)
|
| 102 |
+
- **Publication date** and relevance
|
| 103 |
+
- **Author credentials** when relevant
|
| 104 |
+
|
| 105 |
+
### Contradictory Evidence
|
| 106 |
+
|
| 107 |
+
Document any conflicting information found:
|
| 108 |
+
- Note sources that contradict the claim
|
| 109 |
+
- Explain discrepancies when possible
|
| 110 |
+
- Highlight areas of ongoing debate
|
| 111 |
+
- Flag when context changes interpretation
|
| 112 |
+
|
| 113 |
+
## Step 4: Source Quality Rating
|
| 114 |
+
|
| 115 |
+
Evaluate each source using these criteria (see references/verification_methodology.md for scoring details):
|
| 116 |
+
|
| 117 |
+
**Calculate credibility score (1-100) based on:**
|
| 118 |
+
|
| 119 |
+
1. **Source Credibility (40% weight)**
|
| 120 |
+
- Peer-reviewed academic: 90-100 points
|
| 121 |
+
- Government/official statistics: 80-95 points
|
| 122 |
+
- Reputable news organization: 70-85 points
|
| 123 |
+
- Expert opinion: 60-80 points
|
| 124 |
+
- General news/blogs: 30-60 points
|
| 125 |
+
- Anonymous/unverified: 0-30 points
|
| 126 |
+
|
| 127 |
+
2. **Methodology Quality (30% weight)**
|
| 128 |
+
- Research design rigor
|
| 129 |
+
- Sample size adequacy
|
| 130 |
+
- Statistical significance
|
| 131 |
+
- Control measures
|
| 132 |
+
- Transparency of methods
|
| 133 |
+
|
| 134 |
+
3. **Recency (15% weight)**
|
| 135 |
+
- Within 6 months: 90-100 points
|
| 136 |
+
- 6 months to 2 years: 70-89 points
|
| 137 |
+
- 2-5 years: 50-69 points
|
| 138 |
+
- Over 5 years: 0-49 points
|
| 139 |
+
- (Note: Less important for historical facts)
|
| 140 |
+
|
| 141 |
+
4. **Corroboration (15% weight)**
|
| 142 |
+
- 5+ independent sources: 90-100 points
|
| 143 |
+
- 3-4 independent sources: 70-89 points
|
| 144 |
+
- 1-2 sources: 50-69 points
|
| 145 |
+
- Uncorroborated: 0-49 points
|
| 146 |
+
|
| 147 |
+
**Total Score Formula:**
|
| 148 |
+
(Source Credibility × 0.40) + (Methodology × 0.30) + (Recency × 0.15) + (Corroboration × 0.15)
|
| 149 |
+
|
| 150 |
+
## Step 5: Report Generation
|
| 151 |
+
|
| 152 |
+
Compile findings using this structure:
|
| 153 |
+
|
| 154 |
+
### Executive Summary
|
| 155 |
+
Provide a concise overview (2-4 sentences):
|
| 156 |
+
- Overall credibility assessment
|
| 157 |
+
- Number of claims verified/debunked
|
| 158 |
+
- Key findings or concerns
|
| 159 |
+
- Overall credibility score (1-100)
|
| 160 |
+
|
| 161 |
+
### Detailed Findings
|
| 162 |
+
|
| 163 |
+
For each claim, include:
|
| 164 |
+
|
| 165 |
+
```
|
| 166 |
+
**Claim [number]: [Statement of claim]**
|
| 167 |
+
|
| 168 |
+
**Verification Status:** TRUE/FALSE/PARTIALLY TRUE/UNVERIFIED/OPINION
|
| 169 |
+
**Confidence Level:** HIGH/MEDIUM/LOW ([percentage]%)
|
| 170 |
+
|
| 171 |
+
**Assessment:**
|
| 172 |
+
[2-3 sentence explanation of verification outcome]
|
| 173 |
+
|
| 174 |
+
**Supporting Evidence:**
|
| 175 |
+
- [Source 1] (Credibility: [score]/100) - [Key evidence paraphrased]
|
| 176 |
+
- [Source 2] (Credibility: [score]/100) - [Key evidence paraphrased]
|
| 177 |
+
- [Additional sources as needed]
|
| 178 |
+
|
| 179 |
+
**Contradictory Evidence:**
|
| 180 |
+
[Any conflicting information, or "None found"]
|
| 181 |
+
|
| 182 |
+
**Context Notes:**
|
| 183 |
+
[Important context, limitations, or caveats]
|
| 184 |
+
```
|
| 185 |
+
|
| 186 |
+
### Source Bibliography
|
| 187 |
+
|
| 188 |
+
List all sources with credibility ratings:
|
| 189 |
+
|
| 190 |
+
```
|
| 191 |
+
1. [Source Title/Organization]
|
| 192 |
+
- URL: [link]
|
| 193 |
+
- Type: [Peer-reviewed/Government/News/etc.]
|
| 194 |
+
- Date: [publication date]
|
| 195 |
+
- Credibility Score: [score]/100
|
| 196 |
+
- Strengths: [key strengths]
|
| 197 |
+
- Limitations: [any concerns]
|
| 198 |
+
|
| 199 |
+
2. [Continue for all sources...]
|
| 200 |
+
```
|
| 201 |
+
|
| 202 |
+
### Overall Credibility Score
|
| 203 |
+
|
| 204 |
+
Provide aggregate assessment:
|
| 205 |
+
|
| 206 |
+
**Content Credibility: [score]/100**
|
| 207 |
+
|
| 208 |
+
**Breakdown:**
|
| 209 |
+
- Claims verified as TRUE: [X]
|
| 210 |
+
- Claims verified as FALSE: [X]
|
| 211 |
+
- Claims PARTIALLY TRUE: [X]
|
| 212 |
+
- Claims UNVERIFIED: [X]
|
| 213 |
+
- Average source credibility: [score]/100
|
| 214 |
+
|
| 215 |
+
**Interpretation:**
|
| 216 |
+
[Explanation of what the score means]
|
| 217 |
+
|
| 218 |
+
### Recommendations
|
| 219 |
+
|
| 220 |
+
Provide actionable recommendations:
|
| 221 |
+
|
| 222 |
+
**For further verification:**
|
| 223 |
+
- [Specific actions to improve verification]
|
| 224 |
+
- [Additional sources to consult]
|
| 225 |
+
- [Areas requiring expert review]
|
| 226 |
+
|
| 227 |
+
**Red flags identified:**
|
| 228 |
+
- [Any concerning patterns or issues]
|
| 229 |
+
- [Potential biases or conflicts of interest]
|
| 230 |
+
- [Methodological concerns]
|
| 231 |
+
|
| 232 |
+
## Domain-Specific Guidance
|
| 233 |
+
|
| 234 |
+
### Medical/Health Claims
|
| 235 |
+
- Prioritize PubMed, peer-reviewed medical journals, CDC, WHO
|
| 236 |
+
- Check for FDA approval status when relevant
|
| 237 |
+
- Look for clinical trial data and meta-analyses
|
| 238 |
+
- Be extremely cautious with anecdotal evidence
|
| 239 |
+
- Consider medical consensus
|
| 240 |
+
|
| 241 |
+
### Scientific Claims
|
| 242 |
+
- Search Google Scholar and peer-reviewed journals
|
| 243 |
+
- Check for replication studies
|
| 244 |
+
- Verify methodology and sample sizes
|
| 245 |
+
- Look for scientific consensus
|
| 246 |
+
- Note any conflicts of interest
|
| 247 |
+
|
| 248 |
+
### Statistical Claims
|
| 249 |
+
- Verify with original government databases
|
| 250 |
+
- Check sampling methodology and margin of error
|
| 251 |
+
- Look for statistical significance
|
| 252 |
+
- Consider time period and context
|
| 253 |
+
- Watch for cherry-picking
|
| 254 |
+
|
| 255 |
+
### Historical Claims
|
| 256 |
+
- Seek primary sources and archival records
|
| 257 |
+
- Cross-reference with multiple historians
|
| 258 |
+
- Check academic historical journals
|
| 259 |
+
- Consider historiographical debates
|
| 260 |
+
- Note source dating
|
| 261 |
+
|
| 262 |
+
### Political Claims
|
| 263 |
+
- Use nonpartisan fact-checkers (Snopes, PolitiFact, FactCheck.org)
|
| 264 |
+
- Verify with official government records
|
| 265 |
+
- Check for full context and complete quotes
|
| 266 |
+
- Compare multiple news sources
|
| 267 |
+
- Note partisan framing
|
| 268 |
+
|
| 269 |
+
### Breaking News
|
| 270 |
+
- Exercise extra caution with very recent claims
|
| 271 |
+
- Flag information as preliminary when appropriate
|
| 272 |
+
- Verify with multiple independent sources
|
| 273 |
+
- Note when situation is still developing
|
| 274 |
+
- Update assessment as more information emerges
|
| 275 |
+
|
| 276 |
+
## Important Guidelines
|
| 277 |
+
|
| 278 |
+
**Always:**
|
| 279 |
+
- Search for both supporting and contradictory evidence
|
| 280 |
+
- Paraphrase information from sources (never quote directly)
|
| 281 |
+
- Cite sources with URLs when available
|
| 282 |
+
- Acknowledge uncertainty when evidence is limited
|
| 283 |
+
- Consider context and nuance
|
| 284 |
+
- Note when claims are matters of opinion
|
| 285 |
+
- Flag outdated information
|
| 286 |
+
- Disclose methodological limitations
|
| 287 |
+
|
| 288 |
+
**Never:**
|
| 289 |
+
- Accept first source without verification
|
| 290 |
+
- Ignore publication dates
|
| 291 |
+
- Overlook conflicts of interest
|
| 292 |
+
- Cherry-pick supporting evidence
|
| 293 |
+
- Quote copyrighted content directly
|
| 294 |
+
- Make overconfident claims
|
| 295 |
+
- Ignore credible contradictory evidence
|
| 296 |
+
- Conflate correlation with causation
|
| 297 |
+
|
| 298 |
+
**When evidence is limited:**
|
| 299 |
+
- Clearly state limitations
|
| 300 |
+
- Mark claims as UNVERIFIED
|
| 301 |
+
- Suggest additional verification methods
|
| 302 |
+
- Note what information would be needed for verification
|
| 303 |
+
|
| 304 |
+
## Reference Materials
|
| 305 |
+
|
| 306 |
+
This skill includes detailed reference documentation:
|
| 307 |
+
|
| 308 |
+
### references/trusted_sources.md
|
| 309 |
+
Comprehensive guide to reliable sources organized by category:
|
| 310 |
+
- Academic and research databases (Google Scholar, PubMed, arXiv, etc.)
|
| 311 |
+
- Government and official statistics (Census, CDC, WHO, etc.)
|
| 312 |
+
- Fact-checking organizations (Snopes, PolitiFact, FactCheck.org, etc.)
|
| 313 |
+
- Reputable news organizations with editorial standards
|
| 314 |
+
- Domain-specific sources (medical, scientific, legal, economic)
|
| 315 |
+
- Source quality criteria and red flags
|
| 316 |
+
|
| 317 |
+
**When to reference:** For guidance on which sources to prioritize for different types of claims.
|
| 318 |
+
|
| 319 |
+
### references/verification_methodology.md
|
| 320 |
+
Detailed methodology for verification and credibility assessment:
|
| 321 |
+
- Verification status definitions and criteria
|
| 322 |
+
- Confidence level guidelines
|
| 323 |
+
- Credibility scoring methodology with formulas
|
| 324 |
+
- Special considerations for different domains
|
| 325 |
+
- Common verification pitfalls and best practices
|
| 326 |
+
- Context assessment frameworks
|
| 327 |
+
|
| 328 |
+
**When to reference:** For detailed guidance on assigning verification statuses, calculating credibility scores, or applying domain-specific verification methods.
|
skills/fact-checker/references/trusted_sources.md
ADDED
|
@@ -0,0 +1,155 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Trusted Sources for Fact-Checking
|
| 2 |
+
|
| 3 |
+
## Academic and Research Databases
|
| 4 |
+
|
| 5 |
+
### Primary Sources (Highest Credibility)
|
| 6 |
+
- **Google Scholar** (scholar.google.com) - Comprehensive academic search engine
|
| 7 |
+
- **PubMed** (pubmed.ncbi.nlm.nih.gov) - Biomedical and life sciences literature
|
| 8 |
+
- **arXiv** (arxiv.org) - Preprints in physics, mathematics, computer science
|
| 9 |
+
- **JSTOR** (jstor.org) - Academic journals and primary sources
|
| 10 |
+
- **Web of Science** - Citation database for scientific research
|
| 11 |
+
- **Semantic Scholar** (semanticscholar.org) - AI-powered research tool
|
| 12 |
+
- **IEEE Xplore** - Engineering, computer science, and electronics
|
| 13 |
+
|
| 14 |
+
### Institutional Sources
|
| 15 |
+
- **University research repositories** - Institution-specific research databases
|
| 16 |
+
- **National libraries** - Government-maintained scholarly collections
|
| 17 |
+
- **Research institution publications** - Think tanks and research centers
|
| 18 |
+
|
| 19 |
+
## Government and Official Statistics
|
| 20 |
+
|
| 21 |
+
### Government Databases
|
| 22 |
+
- **Data.gov** - US government open data
|
| 23 |
+
- **Census Bureau** (census.gov) - US demographic and economic data
|
| 24 |
+
- **Bureau of Labor Statistics** (bls.gov) - Employment, inflation, economic indicators
|
| 25 |
+
- **CDC** (cdc.gov) - Health statistics and disease information
|
| 26 |
+
- **FDA** (fda.gov) - Drug, food, and medical device information
|
| 27 |
+
- **EPA** (epa.gov) - Environmental data and regulations
|
| 28 |
+
- **National Archives** - Historical government documents
|
| 29 |
+
|
| 30 |
+
### International Organizations
|
| 31 |
+
- **World Bank** (worldbank.org) - Global development data
|
| 32 |
+
- **WHO** (who.int) - Global health information
|
| 33 |
+
- **UN Statistics** (unstats.un.org) - International demographic and economic data
|
| 34 |
+
- **OECD** (oecd.org) - Economic and social statistics
|
| 35 |
+
- **IMF** (imf.org) - Financial and economic data
|
| 36 |
+
|
| 37 |
+
## Fact-Checking Organizations
|
| 38 |
+
|
| 39 |
+
### Tier 1 Fact-Checkers (Highest Reliability)
|
| 40 |
+
- **Snopes** (snopes.com) - General fact-checking, claims verification
|
| 41 |
+
- **PolitiFact** (politifact.com) - Political claims, Truth-O-Meter ratings
|
| 42 |
+
- **FactCheck.org** (factcheck.org) - Political and policy claims
|
| 43 |
+
- **Reuters Fact Check** (reuters.com/fact-check) - News and viral claims
|
| 44 |
+
- **AP Fact Check** (apnews.com/ap-fact-check) - News verification
|
| 45 |
+
- **Full Fact** (fullfact.org) - UK-focused fact-checking
|
| 46 |
+
|
| 47 |
+
### International Fact-Checkers
|
| 48 |
+
- **Africa Check** - African continent fact-checking
|
| 49 |
+
- **Chequeado** - Latin American fact-checking
|
| 50 |
+
- **Les Décodeurs** (Le Monde) - French fact-checking
|
| 51 |
+
- **Correctiv** - German investigative journalism and fact-checking
|
| 52 |
+
|
| 53 |
+
## Reputable News Organizations
|
| 54 |
+
|
| 55 |
+
### Tier 1 (Highest Editorial Standards)
|
| 56 |
+
- **Associated Press** (AP)
|
| 57 |
+
- **Reuters**
|
| 58 |
+
- **BBC News**
|
| 59 |
+
- **The New York Times**
|
| 60 |
+
- **The Washington Post**
|
| 61 |
+
- **The Wall Street Journal**
|
| 62 |
+
- **The Guardian**
|
| 63 |
+
- **Financial Times**
|
| 64 |
+
- **NPR**
|
| 65 |
+
- **PBS NewsHour**
|
| 66 |
+
|
| 67 |
+
### Tier 2 (Strong Editorial Standards)
|
| 68 |
+
- **The Economist**
|
| 69 |
+
- **The Atlantic**
|
| 70 |
+
- **ProPublica** (investigative journalism)
|
| 71 |
+
- **Bloomberg News**
|
| 72 |
+
- **Los Angeles Times**
|
| 73 |
+
- **The Boston Globe**
|
| 74 |
+
- **USA Today**
|
| 75 |
+
|
| 76 |
+
## Specialized Domain Sources
|
| 77 |
+
|
| 78 |
+
### Medical and Health
|
| 79 |
+
- **The Lancet** - Medical journal
|
| 80 |
+
- **New England Journal of Medicine** - Medical research
|
| 81 |
+
- **JAMA** - Journal of the American Medical Association
|
| 82 |
+
- **Mayo Clinic** - Medical information
|
| 83 |
+
- **Johns Hopkins Medicine** - Health information and research
|
| 84 |
+
|
| 85 |
+
### Science and Technology
|
| 86 |
+
- **Nature** - Scientific journal
|
| 87 |
+
- **Science** - Scientific journal (AAAS)
|
| 88 |
+
- **Scientific American** - Science journalism
|
| 89 |
+
- **MIT Technology Review** - Technology analysis
|
| 90 |
+
- **Ars Technica** - Technology news and analysis
|
| 91 |
+
|
| 92 |
+
### Legal and Policy
|
| 93 |
+
- **Supreme Court Database** - Legal decisions
|
| 94 |
+
- **Congressional Record** - Legislative proceedings
|
| 95 |
+
- **Federal Register** - Federal regulations
|
| 96 |
+
- **Think tanks** - Brookings Institution, RAND Corporation, Council on Foreign Relations
|
| 97 |
+
|
| 98 |
+
### Economics and Business
|
| 99 |
+
- **Federal Reserve** - Economic data and research
|
| 100 |
+
- **National Bureau of Economic Research** - Economic research
|
| 101 |
+
- **World Economic Forum** - Economic analysis
|
| 102 |
+
|
| 103 |
+
## Source Quality Criteria
|
| 104 |
+
|
| 105 |
+
### Credibility Indicators
|
| 106 |
+
1. **Peer review status** - Has the work been peer-reviewed?
|
| 107 |
+
2. **Author credentials** - What are the author's qualifications and affiliations?
|
| 108 |
+
3. **Publication reputation** - What is the journal or publisher's impact factor?
|
| 109 |
+
4. **Methodology** - Is the research methodology sound and transparent?
|
| 110 |
+
5. **Citations** - How often is this source cited by others?
|
| 111 |
+
6. **Conflicts of interest** - Are potential biases disclosed?
|
| 112 |
+
7. **Replication** - Have the findings been replicated?
|
| 113 |
+
8. **Recency** - How current is the information?
|
| 114 |
+
|
| 115 |
+
### Red Flags
|
| 116 |
+
- Anonymous or unattributed sources
|
| 117 |
+
- Lack of citations or references
|
| 118 |
+
- Sensationalized headlines
|
| 119 |
+
- Partisan or advocacy websites without disclosure
|
| 120 |
+
- Unverifiable claims
|
| 121 |
+
- Poor grammar or unprofessional presentation
|
| 122 |
+
- Circular sourcing (sources citing each other)
|
| 123 |
+
- Cherry-picked data
|
| 124 |
+
|
| 125 |
+
## Domain-Specific Considerations
|
| 126 |
+
|
| 127 |
+
### Medical Claims
|
| 128 |
+
- Prioritize peer-reviewed medical journals
|
| 129 |
+
- Check for FDA approval status
|
| 130 |
+
- Verify with medical institutions (Mayo Clinic, Johns Hopkins)
|
| 131 |
+
- Be cautious of anecdotal evidence
|
| 132 |
+
|
| 133 |
+
### Scientific Claims
|
| 134 |
+
- Look for peer-reviewed publications
|
| 135 |
+
- Check for replication studies
|
| 136 |
+
- Verify methodology and sample sizes
|
| 137 |
+
- Consider scientific consensus
|
| 138 |
+
|
| 139 |
+
### Statistical Claims
|
| 140 |
+
- Verify with original data sources (government databases)
|
| 141 |
+
- Check methodology and sample sizes
|
| 142 |
+
- Look for margin of error
|
| 143 |
+
- Consider time period and context
|
| 144 |
+
|
| 145 |
+
### Historical Claims
|
| 146 |
+
- Verify with primary sources when possible
|
| 147 |
+
- Cross-reference with multiple historians
|
| 148 |
+
- Check archival records
|
| 149 |
+
- Consider historiographical debates
|
| 150 |
+
|
| 151 |
+
### Political Claims
|
| 152 |
+
- Use nonpartisan fact-checkers
|
| 153 |
+
- Verify with official government sources
|
| 154 |
+
- Check for context and full quotes
|
| 155 |
+
- Compare multiple news sources
|
skills/fact-checker/references/verification_methodology.md
ADDED
|
@@ -0,0 +1,316 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
# Verification Methodology
|
| 2 |
+
|
| 3 |
+
## Verification Status Categories
|
| 4 |
+
|
| 5 |
+
### TRUE
|
| 6 |
+
**Definition:** The claim is accurate and supported by reliable evidence.
|
| 7 |
+
|
| 8 |
+
**Criteria:**
|
| 9 |
+
- Supported by multiple high-quality sources
|
| 10 |
+
- Primary sources confirm the claim
|
| 11 |
+
- No significant contradictory evidence exists
|
| 12 |
+
- Context does not materially change the claim
|
| 13 |
+
|
| 14 |
+
**Confidence Levels:**
|
| 15 |
+
- **High Confidence:** Multiple peer-reviewed sources or primary sources
|
| 16 |
+
- **Medium Confidence:** Reliable secondary sources with good methodology
|
| 17 |
+
- **Low Confidence:** Single reliable source or indirect evidence
|
| 18 |
+
|
| 19 |
+
### FALSE
|
| 20 |
+
**Definition:** The claim is demonstrably incorrect.
|
| 21 |
+
|
| 22 |
+
**Criteria:**
|
| 23 |
+
- Contradicted by reliable evidence
|
| 24 |
+
- Based on misrepresentation or fabrication
|
| 25 |
+
- Lacks any credible supporting evidence
|
| 26 |
+
- Context reveals the claim to be misleading
|
| 27 |
+
|
| 28 |
+
**Confidence Levels:**
|
| 29 |
+
- **High Confidence:** Multiple sources debunk the claim; clear evidence of falsehood
|
| 30 |
+
- **Medium Confidence:** Contradicted by reliable sources; limited supporting evidence
|
| 31 |
+
- **Low Confidence:** Likely false but evidence is incomplete
|
| 32 |
+
|
| 33 |
+
### PARTIALLY TRUE
|
| 34 |
+
**Definition:** The claim contains elements of truth but is incomplete, misleading, or lacks important context.
|
| 35 |
+
|
| 36 |
+
**Criteria:**
|
| 37 |
+
- Core fact is accurate but missing crucial context
|
| 38 |
+
- Claim is technically true but misleading in presentation
|
| 39 |
+
- Some parts are accurate while others are not
|
| 40 |
+
- Truth depends on specific interpretation or framing
|
| 41 |
+
|
| 42 |
+
**Examples:**
|
| 43 |
+
- Statistics cited correctly but from outdated source
|
| 44 |
+
- Quote is accurate but taken out of context
|
| 45 |
+
- Claim is true for subset but generalized incorrectly
|
| 46 |
+
|
| 47 |
+
### UNVERIFIED
|
| 48 |
+
**Definition:** Insufficient evidence exists to confirm or deny the claim.
|
| 49 |
+
|
| 50 |
+
**Criteria:**
|
| 51 |
+
- No reliable sources found to support or contradict
|
| 52 |
+
- Claim is too vague or ambiguous to verify
|
| 53 |
+
- Sources conflict without clear resolution
|
| 54 |
+
- Evidence is unavailable or inaccessible
|
| 55 |
+
|
| 56 |
+
**Note:** Unverified does not mean false; it means verification is not currently possible.
|
| 57 |
+
|
| 58 |
+
### OPINION/SUBJECTIVE
|
| 59 |
+
**Definition:** The statement is a matter of opinion, prediction, or subjective judgment rather than verifiable fact.
|
| 60 |
+
|
| 61 |
+
**Examples:**
|
| 62 |
+
- "The best movie of the year"
|
| 63 |
+
- "This policy will be harmful"
|
| 64 |
+
- Future predictions
|
| 65 |
+
- Value judgments
|
| 66 |
+
|
| 67 |
+
**Note:** While opinions cannot be fact-checked, underlying factual premises can be verified.
|
| 68 |
+
|
| 69 |
+
## Confidence Level Guidelines
|
| 70 |
+
|
| 71 |
+
### High Confidence (85-100%)
|
| 72 |
+
**Requirements:**
|
| 73 |
+
- Multiple independent, highly reliable sources confirm
|
| 74 |
+
- Primary sources available
|
| 75 |
+
- Peer-reviewed research supports claim
|
| 76 |
+
- Expert consensus exists
|
| 77 |
+
- Recent information (for current events)
|
| 78 |
+
|
| 79 |
+
**Examples:**
|
| 80 |
+
- Peer-reviewed scientific studies with replication
|
| 81 |
+
- Official government statistics
|
| 82 |
+
- Court records and legal documents
|
| 83 |
+
- Multiple firsthand accounts
|
| 84 |
+
|
| 85 |
+
### Medium Confidence (60-84%)
|
| 86 |
+
**Requirements:**
|
| 87 |
+
- Reliable secondary sources support claim
|
| 88 |
+
- Some corroboration but gaps exist
|
| 89 |
+
- Expert opinion without full consensus
|
| 90 |
+
- Indirect evidence supports claim
|
| 91 |
+
|
| 92 |
+
**Examples:**
|
| 93 |
+
- Reputable news reports without primary source confirmation
|
| 94 |
+
- Single academic study without replication
|
| 95 |
+
- Expert testimony without peer review
|
| 96 |
+
- Circumstantial evidence
|
| 97 |
+
|
| 98 |
+
### Low Confidence (40-59%)
|
| 99 |
+
**Requirements:**
|
| 100 |
+
- Limited sources available
|
| 101 |
+
- Sources have moderate credibility
|
| 102 |
+
- Evidence is circumstantial or indirect
|
| 103 |
+
- Conflicting information exists
|
| 104 |
+
|
| 105 |
+
**Examples:**
|
| 106 |
+
- Single news report without corroboration
|
| 107 |
+
- Unnamed or anonymous sources
|
| 108 |
+
- Preliminary findings
|
| 109 |
+
- Historical claims with limited documentation
|
| 110 |
+
|
| 111 |
+
### Insufficient Evidence (<40%)
|
| 112 |
+
**Characteristics:**
|
| 113 |
+
- Very few or no reliable sources
|
| 114 |
+
- Highly speculative or based on rumor
|
| 115 |
+
- Sources lack credibility
|
| 116 |
+
- Too little information to make determination
|
| 117 |
+
|
| 118 |
+
## Credibility Scoring Methodology
|
| 119 |
+
|
| 120 |
+
### Source Credibility (40% weight)
|
| 121 |
+
|
| 122 |
+
**Peer-reviewed academic (90-100 points):**
|
| 123 |
+
- Published in high-impact journal
|
| 124 |
+
- Rigorous peer review
|
| 125 |
+
- Reputable institution
|
| 126 |
+
|
| 127 |
+
**Government/Official statistics (80-95 points):**
|
| 128 |
+
- Official government database
|
| 129 |
+
- Established methodology
|
| 130 |
+
- Transparent data collection
|
| 131 |
+
|
| 132 |
+
**Reputable news organization (70-85 points):**
|
| 133 |
+
- Editorial standards
|
| 134 |
+
- Fact-checking process
|
| 135 |
+
- Track record of accuracy
|
| 136 |
+
|
| 137 |
+
**Expert opinion (60-80 points):**
|
| 138 |
+
- Relevant credentials
|
| 139 |
+
- Independent expert
|
| 140 |
+
- Disclosed affiliations
|
| 141 |
+
|
| 142 |
+
**General news/blogs (30-60 points):**
|
| 143 |
+
- Variable credibility
|
| 144 |
+
- May lack fact-checking
|
| 145 |
+
- Potential biases
|
| 146 |
+
|
| 147 |
+
**Anonymous/unverified (0-30 points):**
|
| 148 |
+
- No attribution
|
| 149 |
+
- No verification possible
|
| 150 |
+
- High risk of inaccuracy
|
| 151 |
+
|
| 152 |
+
### Methodology Quality (30% weight)
|
| 153 |
+
|
| 154 |
+
**Excellent methodology (90-100 points):**
|
| 155 |
+
- Rigorous research design
|
| 156 |
+
- Large sample size
|
| 157 |
+
- Controlled conditions
|
| 158 |
+
- Statistical significance
|
| 159 |
+
- Replication studies
|
| 160 |
+
|
| 161 |
+
**Good methodology (70-89 points):**
|
| 162 |
+
- Sound research design
|
| 163 |
+
- Adequate sample size
|
| 164 |
+
- Clear methodology
|
| 165 |
+
- Appropriate controls
|
| 166 |
+
|
| 167 |
+
**Fair methodology (50-69 points):**
|
| 168 |
+
- Basic research approach
|
| 169 |
+
- Limited sample size
|
| 170 |
+
- Some methodological concerns
|
| 171 |
+
- Incomplete controls
|
| 172 |
+
|
| 173 |
+
**Poor methodology (0-49 points):**
|
| 174 |
+
- Flawed research design
|
| 175 |
+
- Insufficient data
|
| 176 |
+
- Biased sampling
|
| 177 |
+
- Lack of controls
|
| 178 |
+
|
| 179 |
+
### Recency (15% weight)
|
| 180 |
+
|
| 181 |
+
**Very recent (90-100 points):**
|
| 182 |
+
- Within last 6 months
|
| 183 |
+
- Highly relevant for current events
|
| 184 |
+
- Up-to-date information
|
| 185 |
+
|
| 186 |
+
**Recent (70-89 points):**
|
| 187 |
+
- 6 months to 2 years
|
| 188 |
+
- Still relevant for most topics
|
| 189 |
+
- Minor temporal concerns
|
| 190 |
+
|
| 191 |
+
**Moderately dated (50-69 points):**
|
| 192 |
+
- 2-5 years old
|
| 193 |
+
- May need updating
|
| 194 |
+
- Context may have changed
|
| 195 |
+
|
| 196 |
+
**Dated (0-49 points):**
|
| 197 |
+
- Over 5 years old
|
| 198 |
+
- Significant context changes
|
| 199 |
+
- Potentially outdated information
|
| 200 |
+
|
| 201 |
+
**Note:** Recency matters less for historical facts and more for statistics, policies, and current events.
|
| 202 |
+
|
| 203 |
+
### Corroboration (15% weight)
|
| 204 |
+
|
| 205 |
+
**Highly corroborated (90-100 points):**
|
| 206 |
+
- 5+ independent sources confirm
|
| 207 |
+
- Consensus across multiple domains
|
| 208 |
+
- No credible contradictions
|
| 209 |
+
|
| 210 |
+
**Well corroborated (70-89 points):**
|
| 211 |
+
- 3-4 independent sources confirm
|
| 212 |
+
- Some agreement across sources
|
| 213 |
+
- Minor contradictions on details
|
| 214 |
+
|
| 215 |
+
**Minimally corroborated (50-69 points):**
|
| 216 |
+
- 1-2 sources confirm
|
| 217 |
+
- Limited additional evidence
|
| 218 |
+
- Some conflicting information
|
| 219 |
+
|
| 220 |
+
**Uncorroborated (0-49 points):**
|
| 221 |
+
- Single source or no confirmation
|
| 222 |
+
- Conflicting information
|
| 223 |
+
- Lack of verification
|
| 224 |
+
|
| 225 |
+
## Overall Credibility Score Calculation
|
| 226 |
+
|
| 227 |
+
**Formula:**
|
| 228 |
+
Total Score = (Source Credibility × 0.40) + (Methodology × 0.30) + (Recency × 0.15) + (Corroboration × 0.15)
|
| 229 |
+
|
| 230 |
+
**Score Interpretation:**
|
| 231 |
+
- **90-100:** Highly reliable - Strong evidence from multiple excellent sources
|
| 232 |
+
- **80-89:** Very reliable - Good evidence from reputable sources
|
| 233 |
+
- **70-79:** Reliable - Adequate evidence with minor concerns
|
| 234 |
+
- **60-69:** Moderately reliable - Some concerns about evidence quality
|
| 235 |
+
- **50-59:** Questionable - Significant concerns about reliability
|
| 236 |
+
- **Below 50:** Unreliable - Insufficient or poor-quality evidence
|
| 237 |
+
|
| 238 |
+
## Special Considerations
|
| 239 |
+
|
| 240 |
+
### Statistical Claims
|
| 241 |
+
- Verify original data source
|
| 242 |
+
- Check for sampling methodology
|
| 243 |
+
- Look for margin of error
|
| 244 |
+
- Consider statistical significance
|
| 245 |
+
- Check for cherry-picking
|
| 246 |
+
|
| 247 |
+
### Medical/Health Claims
|
| 248 |
+
- Prioritize peer-reviewed medical journals
|
| 249 |
+
- Check for FDA approval (when relevant)
|
| 250 |
+
- Look for clinical trial data
|
| 251 |
+
- Consider consensus of medical community
|
| 252 |
+
- Be wary of anecdotal evidence
|
| 253 |
+
|
| 254 |
+
### Historical Claims
|
| 255 |
+
- Seek primary sources
|
| 256 |
+
- Cross-reference with historians
|
| 257 |
+
- Consider historiographical context
|
| 258 |
+
- Check archival records
|
| 259 |
+
- Note scholarly debates
|
| 260 |
+
|
| 261 |
+
### Political Claims
|
| 262 |
+
- Use nonpartisan fact-checkers
|
| 263 |
+
- Verify with official records
|
| 264 |
+
- Check for full context and quotes
|
| 265 |
+
- Compare multiple news sources
|
| 266 |
+
- Note partisan framing
|
| 267 |
+
|
| 268 |
+
### Scientific Claims
|
| 269 |
+
- Look for peer review
|
| 270 |
+
- Check for replication studies
|
| 271 |
+
- Verify methodology
|
| 272 |
+
- Consider scientific consensus
|
| 273 |
+
- Note any conflicts of interest
|
| 274 |
+
|
| 275 |
+
### Breaking News
|
| 276 |
+
- Use extra caution with very recent claims
|
| 277 |
+
- Verify with multiple sources
|
| 278 |
+
- Note when information is developing
|
| 279 |
+
- Flag preliminary information
|
| 280 |
+
- Update as more information becomes available
|
| 281 |
+
|
| 282 |
+
## Context Assessment
|
| 283 |
+
|
| 284 |
+
**Critical Context Elements:**
|
| 285 |
+
1. **Timing:** When did the event occur or statement was made?
|
| 286 |
+
2. **Full quote:** Is the quote complete or taken out of context?
|
| 287 |
+
3. **Methodology:** How was data collected or conclusion reached?
|
| 288 |
+
4. **Scope:** Does the claim overgeneralize or oversimplify?
|
| 289 |
+
5. **Causation vs correlation:** Is causality inappropriately claimed?
|
| 290 |
+
6. **Comparison:** Are comparisons fair and appropriate?
|
| 291 |
+
7. **Definition:** Are terms used consistently and appropriately?
|
| 292 |
+
|
| 293 |
+
## Common Verification Pitfalls
|
| 294 |
+
|
| 295 |
+
### Avoid:
|
| 296 |
+
- Accepting first source without verification
|
| 297 |
+
- Ignoring publication date
|
| 298 |
+
- Missing important context
|
| 299 |
+
- Overlooking conflicts of interest
|
| 300 |
+
- Failing to check primary sources
|
| 301 |
+
- Cherry-picking supporting evidence
|
| 302 |
+
- Ignoring credible contradictory evidence
|
| 303 |
+
- Conflating correlation with causation
|
| 304 |
+
- Over-relying on single source type
|
| 305 |
+
|
| 306 |
+
### Best Practices:
|
| 307 |
+
- Cross-reference multiple independent sources
|
| 308 |
+
- Seek primary sources when possible
|
| 309 |
+
- Check author credentials and affiliations
|
| 310 |
+
- Verify publication reputation
|
| 311 |
+
- Consider recency and relevance
|
| 312 |
+
- Look for peer review
|
| 313 |
+
- Check for replication
|
| 314 |
+
- Assess methodology
|
| 315 |
+
- Consider broader context
|
| 316 |
+
- Flag uncertainties clearly
|