3morixd commited on
Commit
4f83830
Β·
verified Β·
1 Parent(s): a0c074e

Upload app.py with huggingface_hub

Browse files
Files changed (1) hide show
  1. app.py +72 -0
app.py ADDED
@@ -0,0 +1,72 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ import gradio as gr
2
+
3
+ with gr.Blocks(theme=gr.themes.Soft(primary_hue="blue"), title="Quick Start") as demo:
4
+ gr.Markdown("""
5
+ # πŸš€ dispatchAI Quick Start Guide
6
+
7
+ ## Step 1: Install
8
+
9
+ ```bash
10
+ pip install dispatchai[gguf]
11
+ ```
12
+
13
+ ## Step 2: Load a Model
14
+
15
+ ```python
16
+ from dispatchai import load_model
17
+ model = load_model("SmolLM2-135M-Instruct-mobile", backend="gguf")
18
+ ```
19
+
20
+ ## Step 3: Chat!
21
+
22
+ ```python
23
+ print(model.chat("What is the capital of France?"))
24
+ # β†’ "The capital of France is Paris."
25
+ ```
26
+
27
+ ## Step 4: Find the Right Model
28
+
29
+ ```python
30
+ from dispatchai import recommend
31
+ rec = recommend(ram_mb=2048, task="chat")
32
+ print(f"Best for 2GB RAM: {rec['recommended']['name']}")
33
+ ```
34
+
35
+ ## Step 5: Check Savings
36
+
37
+ ```python
38
+ from dispatchai import calculate_cost
39
+ result = calculate_cost(daily_queries=10000)
40
+ print(f"Save ${result['savings']}/year vs cloud")
41
+ ```
42
+
43
+ ## Verified Models
44
+
45
+ - βœ… 31 models fully working
46
+ - ❌ 0 broken
47
+ - ⚠️ 0 partial
48
+ - πŸ“± 3 phone-verified on Snapdragon 865
49
+
50
+ ## Top 3 Models
51
+
52
+ | Model | Size | Speed | Phone Speed |
53
+ |-------|------|-------|-------------|
54
+ | SmolLM2-135M | 101MB | 59.7 t/s | 46.0 t/s |
55
+ | Qwen2.5-0.5B-int4 | 469MB | 12.5 t/s | 23.2 t/s |
56
+ | Llama-3.2-1B-Q4 | 770MB | 11.3 t/s | 5.4 t/s |
57
+
58
+ ## Links
59
+
60
+ - [All Models](https://huggingface.co/dispatchAI)
61
+ - [SDK](https://huggingface.co/dispatchAI/dispatchAI-SDK)
62
+ - [MCP Hub](https://huggingface.co/spaces/dispatchAI/mcp-hub)
63
+ - [Leaderboard](https://huggingface.co/spaces/dispatchAI/mobile-llm-leaderboard)
64
+ - [Hub](https://huggingface.co/spaces/dispatchAI/hub)
65
+
66
+ ---
67
+
68
+ Dispatch AI (FZE) β€” Sharjah, UAE. License No. 10818.
69
+
70
+ πŸš€ [dispatchAI](https://huggingface.co/dispatchAI) β€” Small. Mobile. Free. UAE-built.
71
+ """)
72
+ demo.launch()