fdaudens commited on
Commit
ac4ea2d
·
verified ·
1 Parent(s): e593c34

Upload 3 files

Browse files
skills/fact-checker/SKILL.md ADDED
@@ -0,0 +1,328 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ name: fact-checker
3
+ description: Comprehensive fact-checking and verification system for analyzing text, articles, or webpage content for factual accuracy. Use when users ask to verify claims, fact-check articles, assess credibility of information, check sources, validate statements, or determine if something is true or false. Also use for requests to analyze misinformation, verify news articles, check social media claims, or assess the reliability of sources.
4
+ ---
5
+
6
+ # Fact Checker
7
+
8
+ ## Overview
9
+
10
+ Analyze text, articles, and webpage content for factual accuracy using rigorous verification methodology. Extract verifiable claims, cross-reference against trusted academic and authoritative sources, assess credibility, and provide comprehensive verification reports with supporting evidence.
11
+
12
+ ## Fact-Checking Workflow
13
+
14
+ Follow these steps for thorough fact-checking:
15
+
16
+ 1. **Claim Extraction** - Identify all verifiable factual claims
17
+ 2. **Source Research** - Search trusted sources for verification
18
+ 3. **Credibility Assessment** - Evaluate each claim with evidence
19
+ 4. **Quality Rating** - Score sources using established criteria
20
+ 5. **Report Generation** - Compile findings in structured format
21
+
22
+ ## Step 1: Claim Extraction
23
+
24
+ Identify and list all factual claims that can be verified:
25
+
26
+ **Extract claims that are:**
27
+ - Specific and measurable (statistics, dates, quotes)
28
+ - Objectively verifiable (events, facts, scientific statements)
29
+ - Attributable to specific sources (when cited)
30
+
31
+ **Exclude:**
32
+ - Opinions and subjective judgments
33
+ - Future predictions (unless assessing past predictions)
34
+ - Vague or ambiguous statements
35
+ - Questions or rhetorical statements
36
+
37
+ **Format extracted claims as:**
38
+ ```
39
+ Claim 1: [Specific factual statement]
40
+ Claim 2: [Specific factual statement]
41
+ Claim 3: [Specific factual statement]
42
+ ```
43
+
44
+ ## Step 2: Source Research
45
+
46
+ For each claim, search trusted sources systematically:
47
+
48
+ **Search priority order:**
49
+ 1. **Academic sources first** - Use web_search with terms like "site:scholar.google.com [claim]", "site:pubmed.ncbi.nlm.nih.gov [claim]", or "[claim] peer reviewed study"
50
+ 2. **Government databases** - For statistics and official data, search "site:gov [claim]" or specific databases (census.gov, cdc.gov, etc.)
51
+ 3. **Fact-checking organizations** - Search "site:snopes.com [claim]", "site:politifact.com [claim]", "site:factcheck.org [claim]"
52
+ 4. **Reputable news sources** - Cross-reference with established news organizations
53
+ 5. **Domain-specific experts** - For specialized topics, seek expert sources
54
+
55
+ **Search strategies:**
56
+ - Use web_search tool with specific keywords from the claim
57
+ - Search for both supporting and contradictory evidence
58
+ - Use web_fetch to retrieve full content of promising sources
59
+ - Check multiple independent sources for corroboration
60
+ - Look for original/primary sources when possible
61
+
62
+ **For each claim, aim to find:**
63
+ - At least 2-3 independent sources
64
+ - Primary sources when available
65
+ - Recent sources (especially for current events)
66
+ - Sources with documented methodology
67
+
68
+ ## Step 3: Credibility Assessment
69
+
70
+ For each claim, provide a detailed assessment:
71
+
72
+ ### Verification Status
73
+
74
+ Assign one of these statuses (see references/verification_methodology.md for detailed criteria):
75
+
76
+ **TRUE:** Supported by reliable evidence from multiple sources with no significant contradictions
77
+
78
+ **FALSE:** Contradicted by reliable evidence; demonstrably incorrect
79
+
80
+ **PARTIALLY TRUE:** Contains elements of truth but incomplete, misleading, or lacks crucial context
81
+
82
+ **UNVERIFIED:** Insufficient evidence to confirm or deny; conflicting sources without resolution
83
+
84
+ **OPINION/SUBJECTIVE:** Matter of opinion or judgment rather than verifiable fact
85
+
86
+ ### Confidence Level
87
+
88
+ Rate confidence based on evidence quality:
89
+
90
+ **HIGH (85-100%):** Multiple independent reliable sources confirm; primary sources available; peer-reviewed research; expert consensus
91
+
92
+ **MEDIUM (60-84%):** Reliable secondary sources; some corroboration; expert opinion without full consensus; indirect evidence
93
+
94
+ **LOW (40-59%):** Limited sources; moderate credibility; circumstantial evidence; conflicting information exists
95
+
96
+ ### Supporting Evidence
97
+
98
+ For each claim, document:
99
+ - **Source citations** with web_fetch URLs when available
100
+ - **Key evidence** from each source (paraphrased, never quoted directly)
101
+ - **Source type** (peer-reviewed study, government data, news report, etc.)
102
+ - **Publication date** and relevance
103
+ - **Author credentials** when relevant
104
+
105
+ ### Contradictory Evidence
106
+
107
+ Document any conflicting information found:
108
+ - Note sources that contradict the claim
109
+ - Explain discrepancies when possible
110
+ - Highlight areas of ongoing debate
111
+ - Flag when context changes interpretation
112
+
113
+ ## Step 4: Source Quality Rating
114
+
115
+ Evaluate each source using these criteria (see references/verification_methodology.md for scoring details):
116
+
117
+ **Calculate credibility score (1-100) based on:**
118
+
119
+ 1. **Source Credibility (40% weight)**
120
+ - Peer-reviewed academic: 90-100 points
121
+ - Government/official statistics: 80-95 points
122
+ - Reputable news organization: 70-85 points
123
+ - Expert opinion: 60-80 points
124
+ - General news/blogs: 30-60 points
125
+ - Anonymous/unverified: 0-30 points
126
+
127
+ 2. **Methodology Quality (30% weight)**
128
+ - Research design rigor
129
+ - Sample size adequacy
130
+ - Statistical significance
131
+ - Control measures
132
+ - Transparency of methods
133
+
134
+ 3. **Recency (15% weight)**
135
+ - Within 6 months: 90-100 points
136
+ - 6 months to 2 years: 70-89 points
137
+ - 2-5 years: 50-69 points
138
+ - Over 5 years: 0-49 points
139
+ - (Note: Less important for historical facts)
140
+
141
+ 4. **Corroboration (15% weight)**
142
+ - 5+ independent sources: 90-100 points
143
+ - 3-4 independent sources: 70-89 points
144
+ - 1-2 sources: 50-69 points
145
+ - Uncorroborated: 0-49 points
146
+
147
+ **Total Score Formula:**
148
+ (Source Credibility × 0.40) + (Methodology × 0.30) + (Recency × 0.15) + (Corroboration × 0.15)
149
+
150
+ ## Step 5: Report Generation
151
+
152
+ Compile findings using this structure:
153
+
154
+ ### Executive Summary
155
+ Provide a concise overview (2-4 sentences):
156
+ - Overall credibility assessment
157
+ - Number of claims verified/debunked
158
+ - Key findings or concerns
159
+ - Overall credibility score (1-100)
160
+
161
+ ### Detailed Findings
162
+
163
+ For each claim, include:
164
+
165
+ ```
166
+ **Claim [number]: [Statement of claim]**
167
+
168
+ **Verification Status:** TRUE/FALSE/PARTIALLY TRUE/UNVERIFIED/OPINION
169
+ **Confidence Level:** HIGH/MEDIUM/LOW ([percentage]%)
170
+
171
+ **Assessment:**
172
+ [2-3 sentence explanation of verification outcome]
173
+
174
+ **Supporting Evidence:**
175
+ - [Source 1] (Credibility: [score]/100) - [Key evidence paraphrased]
176
+ - [Source 2] (Credibility: [score]/100) - [Key evidence paraphrased]
177
+ - [Additional sources as needed]
178
+
179
+ **Contradictory Evidence:**
180
+ [Any conflicting information, or "None found"]
181
+
182
+ **Context Notes:**
183
+ [Important context, limitations, or caveats]
184
+ ```
185
+
186
+ ### Source Bibliography
187
+
188
+ List all sources with credibility ratings:
189
+
190
+ ```
191
+ 1. [Source Title/Organization]
192
+ - URL: [link]
193
+ - Type: [Peer-reviewed/Government/News/etc.]
194
+ - Date: [publication date]
195
+ - Credibility Score: [score]/100
196
+ - Strengths: [key strengths]
197
+ - Limitations: [any concerns]
198
+
199
+ 2. [Continue for all sources...]
200
+ ```
201
+
202
+ ### Overall Credibility Score
203
+
204
+ Provide aggregate assessment:
205
+
206
+ **Content Credibility: [score]/100**
207
+
208
+ **Breakdown:**
209
+ - Claims verified as TRUE: [X]
210
+ - Claims verified as FALSE: [X]
211
+ - Claims PARTIALLY TRUE: [X]
212
+ - Claims UNVERIFIED: [X]
213
+ - Average source credibility: [score]/100
214
+
215
+ **Interpretation:**
216
+ [Explanation of what the score means]
217
+
218
+ ### Recommendations
219
+
220
+ Provide actionable recommendations:
221
+
222
+ **For further verification:**
223
+ - [Specific actions to improve verification]
224
+ - [Additional sources to consult]
225
+ - [Areas requiring expert review]
226
+
227
+ **Red flags identified:**
228
+ - [Any concerning patterns or issues]
229
+ - [Potential biases or conflicts of interest]
230
+ - [Methodological concerns]
231
+
232
+ ## Domain-Specific Guidance
233
+
234
+ ### Medical/Health Claims
235
+ - Prioritize PubMed, peer-reviewed medical journals, CDC, WHO
236
+ - Check for FDA approval status when relevant
237
+ - Look for clinical trial data and meta-analyses
238
+ - Be extremely cautious with anecdotal evidence
239
+ - Consider medical consensus
240
+
241
+ ### Scientific Claims
242
+ - Search Google Scholar and peer-reviewed journals
243
+ - Check for replication studies
244
+ - Verify methodology and sample sizes
245
+ - Look for scientific consensus
246
+ - Note any conflicts of interest
247
+
248
+ ### Statistical Claims
249
+ - Verify with original government databases
250
+ - Check sampling methodology and margin of error
251
+ - Look for statistical significance
252
+ - Consider time period and context
253
+ - Watch for cherry-picking
254
+
255
+ ### Historical Claims
256
+ - Seek primary sources and archival records
257
+ - Cross-reference with multiple historians
258
+ - Check academic historical journals
259
+ - Consider historiographical debates
260
+ - Note source dating
261
+
262
+ ### Political Claims
263
+ - Use nonpartisan fact-checkers (Snopes, PolitiFact, FactCheck.org)
264
+ - Verify with official government records
265
+ - Check for full context and complete quotes
266
+ - Compare multiple news sources
267
+ - Note partisan framing
268
+
269
+ ### Breaking News
270
+ - Exercise extra caution with very recent claims
271
+ - Flag information as preliminary when appropriate
272
+ - Verify with multiple independent sources
273
+ - Note when situation is still developing
274
+ - Update assessment as more information emerges
275
+
276
+ ## Important Guidelines
277
+
278
+ **Always:**
279
+ - Search for both supporting and contradictory evidence
280
+ - Paraphrase information from sources (never quote directly)
281
+ - Cite sources with URLs when available
282
+ - Acknowledge uncertainty when evidence is limited
283
+ - Consider context and nuance
284
+ - Note when claims are matters of opinion
285
+ - Flag outdated information
286
+ - Disclose methodological limitations
287
+
288
+ **Never:**
289
+ - Accept first source without verification
290
+ - Ignore publication dates
291
+ - Overlook conflicts of interest
292
+ - Cherry-pick supporting evidence
293
+ - Quote copyrighted content directly
294
+ - Make overconfident claims
295
+ - Ignore credible contradictory evidence
296
+ - Conflate correlation with causation
297
+
298
+ **When evidence is limited:**
299
+ - Clearly state limitations
300
+ - Mark claims as UNVERIFIED
301
+ - Suggest additional verification methods
302
+ - Note what information would be needed for verification
303
+
304
+ ## Reference Materials
305
+
306
+ This skill includes detailed reference documentation:
307
+
308
+ ### references/trusted_sources.md
309
+ Comprehensive guide to reliable sources organized by category:
310
+ - Academic and research databases (Google Scholar, PubMed, arXiv, etc.)
311
+ - Government and official statistics (Census, CDC, WHO, etc.)
312
+ - Fact-checking organizations (Snopes, PolitiFact, FactCheck.org, etc.)
313
+ - Reputable news organizations with editorial standards
314
+ - Domain-specific sources (medical, scientific, legal, economic)
315
+ - Source quality criteria and red flags
316
+
317
+ **When to reference:** For guidance on which sources to prioritize for different types of claims.
318
+
319
+ ### references/verification_methodology.md
320
+ Detailed methodology for verification and credibility assessment:
321
+ - Verification status definitions and criteria
322
+ - Confidence level guidelines
323
+ - Credibility scoring methodology with formulas
324
+ - Special considerations for different domains
325
+ - Common verification pitfalls and best practices
326
+ - Context assessment frameworks
327
+
328
+ **When to reference:** For detailed guidance on assigning verification statuses, calculating credibility scores, or applying domain-specific verification methods.
skills/fact-checker/references/trusted_sources.md ADDED
@@ -0,0 +1,155 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Trusted Sources for Fact-Checking
2
+
3
+ ## Academic and Research Databases
4
+
5
+ ### Primary Sources (Highest Credibility)
6
+ - **Google Scholar** (scholar.google.com) - Comprehensive academic search engine
7
+ - **PubMed** (pubmed.ncbi.nlm.nih.gov) - Biomedical and life sciences literature
8
+ - **arXiv** (arxiv.org) - Preprints in physics, mathematics, computer science
9
+ - **JSTOR** (jstor.org) - Academic journals and primary sources
10
+ - **Web of Science** - Citation database for scientific research
11
+ - **Semantic Scholar** (semanticscholar.org) - AI-powered research tool
12
+ - **IEEE Xplore** - Engineering, computer science, and electronics
13
+
14
+ ### Institutional Sources
15
+ - **University research repositories** - Institution-specific research databases
16
+ - **National libraries** - Government-maintained scholarly collections
17
+ - **Research institution publications** - Think tanks and research centers
18
+
19
+ ## Government and Official Statistics
20
+
21
+ ### Government Databases
22
+ - **Data.gov** - US government open data
23
+ - **Census Bureau** (census.gov) - US demographic and economic data
24
+ - **Bureau of Labor Statistics** (bls.gov) - Employment, inflation, economic indicators
25
+ - **CDC** (cdc.gov) - Health statistics and disease information
26
+ - **FDA** (fda.gov) - Drug, food, and medical device information
27
+ - **EPA** (epa.gov) - Environmental data and regulations
28
+ - **National Archives** - Historical government documents
29
+
30
+ ### International Organizations
31
+ - **World Bank** (worldbank.org) - Global development data
32
+ - **WHO** (who.int) - Global health information
33
+ - **UN Statistics** (unstats.un.org) - International demographic and economic data
34
+ - **OECD** (oecd.org) - Economic and social statistics
35
+ - **IMF** (imf.org) - Financial and economic data
36
+
37
+ ## Fact-Checking Organizations
38
+
39
+ ### Tier 1 Fact-Checkers (Highest Reliability)
40
+ - **Snopes** (snopes.com) - General fact-checking, claims verification
41
+ - **PolitiFact** (politifact.com) - Political claims, Truth-O-Meter ratings
42
+ - **FactCheck.org** (factcheck.org) - Political and policy claims
43
+ - **Reuters Fact Check** (reuters.com/fact-check) - News and viral claims
44
+ - **AP Fact Check** (apnews.com/ap-fact-check) - News verification
45
+ - **Full Fact** (fullfact.org) - UK-focused fact-checking
46
+
47
+ ### International Fact-Checkers
48
+ - **Africa Check** - African continent fact-checking
49
+ - **Chequeado** - Latin American fact-checking
50
+ - **Les Décodeurs** (Le Monde) - French fact-checking
51
+ - **Correctiv** - German investigative journalism and fact-checking
52
+
53
+ ## Reputable News Organizations
54
+
55
+ ### Tier 1 (Highest Editorial Standards)
56
+ - **Associated Press** (AP)
57
+ - **Reuters**
58
+ - **BBC News**
59
+ - **The New York Times**
60
+ - **The Washington Post**
61
+ - **The Wall Street Journal**
62
+ - **The Guardian**
63
+ - **Financial Times**
64
+ - **NPR**
65
+ - **PBS NewsHour**
66
+
67
+ ### Tier 2 (Strong Editorial Standards)
68
+ - **The Economist**
69
+ - **The Atlantic**
70
+ - **ProPublica** (investigative journalism)
71
+ - **Bloomberg News**
72
+ - **Los Angeles Times**
73
+ - **The Boston Globe**
74
+ - **USA Today**
75
+
76
+ ## Specialized Domain Sources
77
+
78
+ ### Medical and Health
79
+ - **The Lancet** - Medical journal
80
+ - **New England Journal of Medicine** - Medical research
81
+ - **JAMA** - Journal of the American Medical Association
82
+ - **Mayo Clinic** - Medical information
83
+ - **Johns Hopkins Medicine** - Health information and research
84
+
85
+ ### Science and Technology
86
+ - **Nature** - Scientific journal
87
+ - **Science** - Scientific journal (AAAS)
88
+ - **Scientific American** - Science journalism
89
+ - **MIT Technology Review** - Technology analysis
90
+ - **Ars Technica** - Technology news and analysis
91
+
92
+ ### Legal and Policy
93
+ - **Supreme Court Database** - Legal decisions
94
+ - **Congressional Record** - Legislative proceedings
95
+ - **Federal Register** - Federal regulations
96
+ - **Think tanks** - Brookings Institution, RAND Corporation, Council on Foreign Relations
97
+
98
+ ### Economics and Business
99
+ - **Federal Reserve** - Economic data and research
100
+ - **National Bureau of Economic Research** - Economic research
101
+ - **World Economic Forum** - Economic analysis
102
+
103
+ ## Source Quality Criteria
104
+
105
+ ### Credibility Indicators
106
+ 1. **Peer review status** - Has the work been peer-reviewed?
107
+ 2. **Author credentials** - What are the author's qualifications and affiliations?
108
+ 3. **Publication reputation** - What is the journal or publisher's impact factor?
109
+ 4. **Methodology** - Is the research methodology sound and transparent?
110
+ 5. **Citations** - How often is this source cited by others?
111
+ 6. **Conflicts of interest** - Are potential biases disclosed?
112
+ 7. **Replication** - Have the findings been replicated?
113
+ 8. **Recency** - How current is the information?
114
+
115
+ ### Red Flags
116
+ - Anonymous or unattributed sources
117
+ - Lack of citations or references
118
+ - Sensationalized headlines
119
+ - Partisan or advocacy websites without disclosure
120
+ - Unverifiable claims
121
+ - Poor grammar or unprofessional presentation
122
+ - Circular sourcing (sources citing each other)
123
+ - Cherry-picked data
124
+
125
+ ## Domain-Specific Considerations
126
+
127
+ ### Medical Claims
128
+ - Prioritize peer-reviewed medical journals
129
+ - Check for FDA approval status
130
+ - Verify with medical institutions (Mayo Clinic, Johns Hopkins)
131
+ - Be cautious of anecdotal evidence
132
+
133
+ ### Scientific Claims
134
+ - Look for peer-reviewed publications
135
+ - Check for replication studies
136
+ - Verify methodology and sample sizes
137
+ - Consider scientific consensus
138
+
139
+ ### Statistical Claims
140
+ - Verify with original data sources (government databases)
141
+ - Check methodology and sample sizes
142
+ - Look for margin of error
143
+ - Consider time period and context
144
+
145
+ ### Historical Claims
146
+ - Verify with primary sources when possible
147
+ - Cross-reference with multiple historians
148
+ - Check archival records
149
+ - Consider historiographical debates
150
+
151
+ ### Political Claims
152
+ - Use nonpartisan fact-checkers
153
+ - Verify with official government sources
154
+ - Check for context and full quotes
155
+ - Compare multiple news sources
skills/fact-checker/references/verification_methodology.md ADDED
@@ -0,0 +1,316 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ # Verification Methodology
2
+
3
+ ## Verification Status Categories
4
+
5
+ ### TRUE
6
+ **Definition:** The claim is accurate and supported by reliable evidence.
7
+
8
+ **Criteria:**
9
+ - Supported by multiple high-quality sources
10
+ - Primary sources confirm the claim
11
+ - No significant contradictory evidence exists
12
+ - Context does not materially change the claim
13
+
14
+ **Confidence Levels:**
15
+ - **High Confidence:** Multiple peer-reviewed sources or primary sources
16
+ - **Medium Confidence:** Reliable secondary sources with good methodology
17
+ - **Low Confidence:** Single reliable source or indirect evidence
18
+
19
+ ### FALSE
20
+ **Definition:** The claim is demonstrably incorrect.
21
+
22
+ **Criteria:**
23
+ - Contradicted by reliable evidence
24
+ - Based on misrepresentation or fabrication
25
+ - Lacks any credible supporting evidence
26
+ - Context reveals the claim to be misleading
27
+
28
+ **Confidence Levels:**
29
+ - **High Confidence:** Multiple sources debunk the claim; clear evidence of falsehood
30
+ - **Medium Confidence:** Contradicted by reliable sources; limited supporting evidence
31
+ - **Low Confidence:** Likely false but evidence is incomplete
32
+
33
+ ### PARTIALLY TRUE
34
+ **Definition:** The claim contains elements of truth but is incomplete, misleading, or lacks important context.
35
+
36
+ **Criteria:**
37
+ - Core fact is accurate but missing crucial context
38
+ - Claim is technically true but misleading in presentation
39
+ - Some parts are accurate while others are not
40
+ - Truth depends on specific interpretation or framing
41
+
42
+ **Examples:**
43
+ - Statistics cited correctly but from outdated source
44
+ - Quote is accurate but taken out of context
45
+ - Claim is true for subset but generalized incorrectly
46
+
47
+ ### UNVERIFIED
48
+ **Definition:** Insufficient evidence exists to confirm or deny the claim.
49
+
50
+ **Criteria:**
51
+ - No reliable sources found to support or contradict
52
+ - Claim is too vague or ambiguous to verify
53
+ - Sources conflict without clear resolution
54
+ - Evidence is unavailable or inaccessible
55
+
56
+ **Note:** Unverified does not mean false; it means verification is not currently possible.
57
+
58
+ ### OPINION/SUBJECTIVE
59
+ **Definition:** The statement is a matter of opinion, prediction, or subjective judgment rather than verifiable fact.
60
+
61
+ **Examples:**
62
+ - "The best movie of the year"
63
+ - "This policy will be harmful"
64
+ - Future predictions
65
+ - Value judgments
66
+
67
+ **Note:** While opinions cannot be fact-checked, underlying factual premises can be verified.
68
+
69
+ ## Confidence Level Guidelines
70
+
71
+ ### High Confidence (85-100%)
72
+ **Requirements:**
73
+ - Multiple independent, highly reliable sources confirm
74
+ - Primary sources available
75
+ - Peer-reviewed research supports claim
76
+ - Expert consensus exists
77
+ - Recent information (for current events)
78
+
79
+ **Examples:**
80
+ - Peer-reviewed scientific studies with replication
81
+ - Official government statistics
82
+ - Court records and legal documents
83
+ - Multiple firsthand accounts
84
+
85
+ ### Medium Confidence (60-84%)
86
+ **Requirements:**
87
+ - Reliable secondary sources support claim
88
+ - Some corroboration but gaps exist
89
+ - Expert opinion without full consensus
90
+ - Indirect evidence supports claim
91
+
92
+ **Examples:**
93
+ - Reputable news reports without primary source confirmation
94
+ - Single academic study without replication
95
+ - Expert testimony without peer review
96
+ - Circumstantial evidence
97
+
98
+ ### Low Confidence (40-59%)
99
+ **Requirements:**
100
+ - Limited sources available
101
+ - Sources have moderate credibility
102
+ - Evidence is circumstantial or indirect
103
+ - Conflicting information exists
104
+
105
+ **Examples:**
106
+ - Single news report without corroboration
107
+ - Unnamed or anonymous sources
108
+ - Preliminary findings
109
+ - Historical claims with limited documentation
110
+
111
+ ### Insufficient Evidence (<40%)
112
+ **Characteristics:**
113
+ - Very few or no reliable sources
114
+ - Highly speculative or based on rumor
115
+ - Sources lack credibility
116
+ - Too little information to make determination
117
+
118
+ ## Credibility Scoring Methodology
119
+
120
+ ### Source Credibility (40% weight)
121
+
122
+ **Peer-reviewed academic (90-100 points):**
123
+ - Published in high-impact journal
124
+ - Rigorous peer review
125
+ - Reputable institution
126
+
127
+ **Government/Official statistics (80-95 points):**
128
+ - Official government database
129
+ - Established methodology
130
+ - Transparent data collection
131
+
132
+ **Reputable news organization (70-85 points):**
133
+ - Editorial standards
134
+ - Fact-checking process
135
+ - Track record of accuracy
136
+
137
+ **Expert opinion (60-80 points):**
138
+ - Relevant credentials
139
+ - Independent expert
140
+ - Disclosed affiliations
141
+
142
+ **General news/blogs (30-60 points):**
143
+ - Variable credibility
144
+ - May lack fact-checking
145
+ - Potential biases
146
+
147
+ **Anonymous/unverified (0-30 points):**
148
+ - No attribution
149
+ - No verification possible
150
+ - High risk of inaccuracy
151
+
152
+ ### Methodology Quality (30% weight)
153
+
154
+ **Excellent methodology (90-100 points):**
155
+ - Rigorous research design
156
+ - Large sample size
157
+ - Controlled conditions
158
+ - Statistical significance
159
+ - Replication studies
160
+
161
+ **Good methodology (70-89 points):**
162
+ - Sound research design
163
+ - Adequate sample size
164
+ - Clear methodology
165
+ - Appropriate controls
166
+
167
+ **Fair methodology (50-69 points):**
168
+ - Basic research approach
169
+ - Limited sample size
170
+ - Some methodological concerns
171
+ - Incomplete controls
172
+
173
+ **Poor methodology (0-49 points):**
174
+ - Flawed research design
175
+ - Insufficient data
176
+ - Biased sampling
177
+ - Lack of controls
178
+
179
+ ### Recency (15% weight)
180
+
181
+ **Very recent (90-100 points):**
182
+ - Within last 6 months
183
+ - Highly relevant for current events
184
+ - Up-to-date information
185
+
186
+ **Recent (70-89 points):**
187
+ - 6 months to 2 years
188
+ - Still relevant for most topics
189
+ - Minor temporal concerns
190
+
191
+ **Moderately dated (50-69 points):**
192
+ - 2-5 years old
193
+ - May need updating
194
+ - Context may have changed
195
+
196
+ **Dated (0-49 points):**
197
+ - Over 5 years old
198
+ - Significant context changes
199
+ - Potentially outdated information
200
+
201
+ **Note:** Recency matters less for historical facts and more for statistics, policies, and current events.
202
+
203
+ ### Corroboration (15% weight)
204
+
205
+ **Highly corroborated (90-100 points):**
206
+ - 5+ independent sources confirm
207
+ - Consensus across multiple domains
208
+ - No credible contradictions
209
+
210
+ **Well corroborated (70-89 points):**
211
+ - 3-4 independent sources confirm
212
+ - Some agreement across sources
213
+ - Minor contradictions on details
214
+
215
+ **Minimally corroborated (50-69 points):**
216
+ - 1-2 sources confirm
217
+ - Limited additional evidence
218
+ - Some conflicting information
219
+
220
+ **Uncorroborated (0-49 points):**
221
+ - Single source or no confirmation
222
+ - Conflicting information
223
+ - Lack of verification
224
+
225
+ ## Overall Credibility Score Calculation
226
+
227
+ **Formula:**
228
+ Total Score = (Source Credibility × 0.40) + (Methodology × 0.30) + (Recency × 0.15) + (Corroboration × 0.15)
229
+
230
+ **Score Interpretation:**
231
+ - **90-100:** Highly reliable - Strong evidence from multiple excellent sources
232
+ - **80-89:** Very reliable - Good evidence from reputable sources
233
+ - **70-79:** Reliable - Adequate evidence with minor concerns
234
+ - **60-69:** Moderately reliable - Some concerns about evidence quality
235
+ - **50-59:** Questionable - Significant concerns about reliability
236
+ - **Below 50:** Unreliable - Insufficient or poor-quality evidence
237
+
238
+ ## Special Considerations
239
+
240
+ ### Statistical Claims
241
+ - Verify original data source
242
+ - Check for sampling methodology
243
+ - Look for margin of error
244
+ - Consider statistical significance
245
+ - Check for cherry-picking
246
+
247
+ ### Medical/Health Claims
248
+ - Prioritize peer-reviewed medical journals
249
+ - Check for FDA approval (when relevant)
250
+ - Look for clinical trial data
251
+ - Consider consensus of medical community
252
+ - Be wary of anecdotal evidence
253
+
254
+ ### Historical Claims
255
+ - Seek primary sources
256
+ - Cross-reference with historians
257
+ - Consider historiographical context
258
+ - Check archival records
259
+ - Note scholarly debates
260
+
261
+ ### Political Claims
262
+ - Use nonpartisan fact-checkers
263
+ - Verify with official records
264
+ - Check for full context and quotes
265
+ - Compare multiple news sources
266
+ - Note partisan framing
267
+
268
+ ### Scientific Claims
269
+ - Look for peer review
270
+ - Check for replication studies
271
+ - Verify methodology
272
+ - Consider scientific consensus
273
+ - Note any conflicts of interest
274
+
275
+ ### Breaking News
276
+ - Use extra caution with very recent claims
277
+ - Verify with multiple sources
278
+ - Note when information is developing
279
+ - Flag preliminary information
280
+ - Update as more information becomes available
281
+
282
+ ## Context Assessment
283
+
284
+ **Critical Context Elements:**
285
+ 1. **Timing:** When did the event occur or statement was made?
286
+ 2. **Full quote:** Is the quote complete or taken out of context?
287
+ 3. **Methodology:** How was data collected or conclusion reached?
288
+ 4. **Scope:** Does the claim overgeneralize or oversimplify?
289
+ 5. **Causation vs correlation:** Is causality inappropriately claimed?
290
+ 6. **Comparison:** Are comparisons fair and appropriate?
291
+ 7. **Definition:** Are terms used consistently and appropriately?
292
+
293
+ ## Common Verification Pitfalls
294
+
295
+ ### Avoid:
296
+ - Accepting first source without verification
297
+ - Ignoring publication date
298
+ - Missing important context
299
+ - Overlooking conflicts of interest
300
+ - Failing to check primary sources
301
+ - Cherry-picking supporting evidence
302
+ - Ignoring credible contradictory evidence
303
+ - Conflating correlation with causation
304
+ - Over-relying on single source type
305
+
306
+ ### Best Practices:
307
+ - Cross-reference multiple independent sources
308
+ - Seek primary sources when possible
309
+ - Check author credentials and affiliations
310
+ - Verify publication reputation
311
+ - Consider recency and relevance
312
+ - Look for peer review
313
+ - Check for replication
314
+ - Assess methodology
315
+ - Consider broader context
316
+ - Flag uncertainties clearly