report.py

import numpy as np
import markdown
import pdfkit
import json
import shutil
from langsmith import traceable
from helper import retry,clean_report
from crypto import decryption

@traceable(name='report_maker')
@retry(max_attempts=3,delay=3,backoff=3,exceptions=(Exception,))
def report_maker(llm, key, mapping_log, reasoning, internal_finding, domain, feedback=None):
    decrypt_map = decryption(key, mapping_log)
    domain_label=domain['Domain']
    if domain_label=='other' and domain.get('Subdomain',"NIL"):
        domain_label=f"other ({domain['Subdomain']})"
    
    feedback_section=f"\nREVISION FEEDBACK: {feedback}\nAddress this feedback specifically in the revised report.\n" if feedback else ""

    prompt=f"""You are a BI analyst writing a data quality report for C-suite executives.



INPUTS:

Domain Label:{domain_label}

Domain: {domain}

Internal Findings: {json.dumps(internal_finding,indent=2,default=str)}

Causal Reasoning: {json.dumps(reasoning, indent=2,default=str)}

{feedback_section}



MANDATORY: The Causal Reasoning input contains external_evidence fields with real research citations.

You MUST use these in the Root Cause Analysis section.

For each issue, cite the external_evidence exactly like this:

"[External Research: <source query> — <finding>]"

If you do not cite external evidence for at least 3 issues, your report FAILS quality gates.



RULES (apply to every sentence):

1. Every claim cites an exact number from findings. No vague words (high/notable/significant/improve/analyze).

2. Every percentage has a source tag: (industry benchmark) / (pilot data) / (estimate pending validation). Example: 82.37% → 65.90% (20% reduction) and 186.51 → 130.56 (30% reduction) is found in the report - these must be backed up with valid ecternal citations like

industry benchmarks or other target metrics found on external research. If a claim percentage has no source compulsorily omit the percentage claim instead say something like requires baseline period data to set target.

3. Every action has: Owner, Timeline, Phases, Success Metric with current→target numbers.

4. Root causes explain WHY via mechanism, not just WHAT. Link: Issue → Cause → Impact → Action → Outcome.

5. Severity: HIGH=blocks analytics/breaks systems | MEDIUM=reduces accuracy | LOW=optimization.

6. No invented numbers. Only use values present in findings.

7. Be decisive: "Primary driver is X" not "may be caused by X".

8. Word count: MINIMUM 1500 words. Count before submitting.

9.When computing target from current→target, use: target = current × (1 - reduction%). Do not approximate.

10.Integrate external research findings as natural prose, never as raw citation brackets.



OUTPUT — return ONLY this markdown structure, no preamble, no code blocks:



# Executive Summary

[250-300 words. Top 5 issues with exact evidence + 1 key action with owner/timeline/target.]



# Critical Issues

## [Issue Name]

- Evidence: [exact metric, value, unit, n]

- Root Cause: [specific mechanism with supporting data]

- Impact: [quantified business consequence]

- Severity: [HIGH/MEDIUM/LOW—one sentence justification]



[Repeat for each issue]



# Root Cause Analysis

[Per issue: mechanism→evidence ruling out alternatives → business impact link]



# Recommended Actions

[Max 5 actions, ordered by priority]

**Action N: [Title]** (Owner: [Team], Timeline: [X days], Priority: HIGH/MEDIUM)

- Objective: [problem solved + current→target metric]

- Phase 1 ([X days]): [specific step]

- Phase 2 ([X days]): [specific step]

- Phase 3 ([X days]): [specific step]

- Success Metric: [exact number current→target + source]

- Resource Needs: [roles + hours]



# Data Gaps and Next Steps

- [Data needed] (Owner: [Team],[X days]):Impact—[what decision this unlocks]



EXAMPLES:



BAD(invented baseline not in findings):

"Success Metric: 10% improvement in model accuracy (from 80% to 88%)"

— WRONG because 80% accuracy appears nowhere in findings. 88% was invented by calculating 80 × 1.10 = 88, but 80 was never a real number.



GOOD(uses only numbers from findings, shows calculation):

"Success Metric: Reduce Amount outliers by 50% (from 4,076 to 2,038)"

— CORRECT. 4,076 comes from outlier_detection findings. Target = 4,076 × (1 - 0.50) = 2,038.



ANOTHER GOOD EXAMPLE:

"Success Metric: Reduce missing CustomerID from 24.93% to 12.47% (50% reduction)"

— CORRECT. 24.93% comes from profiler null_percent. Target = 24.93 × (1 - 0.50) = 12.465 ≈ 12.47%.



RULE: 

- The starting number MUST exist verbatim in findings or profiler.

- The target MUST be calculated as: target = current × (1 - reduction%).

- Always show the calculation explicitly: "current × (1 - X%) = target"

- If the current baseline is unknown, write:

  "Success Metric: Reduce [metric] to within acceptable threshold — baseline to be established in Phase 1."



ANTI-HALLUCINATION (CRITICAL):

- Impact quantification: ONLY use numbers present in findings. If no impact number exists, write "Impact: Unquantified — requires [specific data] to estimate" — DO NOT invent percentages.

- Root cause ruling-out: ONLY cite evidence present in findings. If no counter-evidence exists, omit the ruling-out section entirely.

- A z-score is NOT a count. Never use a z-score as a quantity to reduce. For outlier actions, success metric must be "% of transactions with |z-score| > 3".

- If a metric has no clear business interpretation (e.g. skewness of 186.5, negative % growth in InvoiceNo), flag it as "Requires domain validation before reporting to C-suite" — do not invent a business narrative.

- Do not cite statistics from external research unless they appear verbatim in the causal_reasoning input. Never invent study findings.

EXAMPLE: 



## 30 Days

## 60 Days  

## 90 Days"""
    max_attempts=3
    for attempt in range(max_attempts):
        report=llm.invoke(prompt).content
        word_count = len(report.split())
        print(f"Attempt {attempt+1}: {word_count} words")
        
        if word_count>=1500:
            break
        
        if attempt<max_attempts-1:
            print(f"Report too short ({word_count} words). Regenerating with expansion prompt...")
            prompt+=f"\n\nPREVIOUS ATTEMPT WAS {word_count} WORDS — TOO SHORT. You must write at least 1500 words. Expand root cause analysis and action phases with more specific detail. Do not add filler — add substance."
    else:
        print(f"Warning: Could not reach 1500 words after {max_attempts} attempts. Using last generated report ({word_count} words).")

    for display,real in decrypt_map.items():
        report=report.replace(display,real)  
    return report

@retry(max_attempts=3,delay=3,backoff=3,exceptions=(Exception,))
def report_generator(report,output_path="outputs/report.pdf"):
    report=clean_report(report).replace('\\n', '\n')
    html_body = markdown.markdown(report, extensions=["tables", "fenced_code", "nl2br"])
    html = f"""

    <!DOCTYPE html>

    <html>

    <head>

    <meta charset="utf-8">

    <style>

    @page {{

        size: A4;

        margin: 2.5cm 2.2cm;

        @bottom-right {{

          content: "Page " counter(page) " of " counter(pages);

          font-size: 9px; color: #888;

        }}

      }}

      body {{ font-family: 'Segoe UI', Arial, sans-serif; font-size: 14px; line-height: 1.7; color: #1a1a2e; }}

      h1 {{ font-size: 28px; font-weight: 700; color: #0f1117; margin: 0 0 10px; padding-bottom: 8px; border-bottom: 2px solid #4f46e5; }}

      h2 {{ font-size: 20px; font-weight: 600; color: #1a1d27; margin: 28px 0 8px; border-left: 3px solid #4f46e5; padding-left: 10px; }}

      h3 {{ font-size: 18px; font-weight: 600; color: #333; margin: 16px 0 6px; }}

      p  {{ margin: 0 0 13px; }}

      ul, ol {{ margin: 0 0 10px 20px; }}

      li {{ margin-bottom: 5px; }}

      strong {{ color: #0f1117; }}

      table {{ width: 100%; border-collapse: collapse; margin: 14px 0; font-size: 13px; }}

      th {{ background: #1a1d27; color: #fff; font-weight: 600; padding: 8px 12px; text-align: left; }}

      td {{ padding: 7px 12px; border-bottom: 0.5px solid #e0e0e0; }}

      tr:nth-child(even) td {{ background: #f9f9fb; }}

      blockquote {{ border-left: 3px solid #4f46e5; margin: 12px 0; padding: 8px 14px; background: #f0f0ff; color: #444; font-style: italic; }}

      hr {{ border: none; border-top: 1px solid #e0e0e0; margin: 20px 0; }}

    </style>

    </head>

    <body>{html_body}</body>

    </html>"""
    
    options ={
        'page-size': 'A4',
        'margin-top': '2.5cm',
        'margin-right': '2.2cm',
        'margin-bottom': '2.5cm',
        'margin-left': '2.2cm',
        'encoding': "UTF-8",
        'no-outline': None,
        'enable-local-file-access': None
    }
    wkhtmltopdf_path = shutil.which("wkhtmltopdf")
    config = pdfkit.configuration(wkhtmltopdf=wkhtmltopdf_path)
    pdfkit.from_string(html, output_path, configuration=config)
    return output_path