5ch4um1 commited on
Commit
ccdfe26
·
verified ·
1 Parent(s): 2d90cdd

Upload README.md with huggingface_hub

Browse files
Files changed (1) hide show
  1. README.md +100 -0
README.md ADDED
@@ -0,0 +1,100 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ base_model: LiquidAI/LFM2.5-VL-450M
3
+ tags:
4
+ - vision-language
5
+ - satellite
6
+ - vrsbench
7
+ - lfm2
8
+ - gguf
9
+ - remote-sensing
10
+ ---
11
+
12
+ # LFM2.5-VL-450M VRSBench LoRA
13
+
14
+ ## Model Description
15
+
16
+ This is a fine-tuned version of LiquidAI's LFM2.5-VL-450M vision-language model, trained on the VRSBench dataset for general satellite image understanding. This serves as the base model for specialized satellite vision tasks.
17
+
18
+ The model can answer questions about satellite imagery, including:
19
+ - Scene classification
20
+ - Object detection and counting
21
+ - Visual question answering about satellite images
22
+ - General satellite image understanding
23
+
24
+ ## Training Details
25
+
26
+ ### VRSBench Training
27
+ - **Base Model**: LFM2.5-VL-450M
28
+ - **Dataset**: VRSBench (Vision Reasoning and Scene Understanding Benchmark)
29
+ - **Epochs**: 1
30
+ - **Method**: LoRA (r=16, alpha=32)
31
+ - **Hardware**: Local GPU training (no Ray/distributed)
32
+
33
+ ## Derived Models
34
+
35
+ This model serves as the base for specialized satellite vision experts:
36
+
37
+ | Model | Dataset | Task | Accuracy/Performance |
38
+ |-------|----------|------|---------------------|
39
+ | [VRSBench + EuroSAT Terrain Expert](https://huggingface.co/5ch4um1/lfm2.5-vrsbench-EUROSAT-terrain-lora-450m) | EuroSAT | Terrain Classification | 97.52% accuracy |
40
+ | [VRSBench + MADOS Maritime Expert](https://huggingface.co/5ch4um1/lfm2.5-vrsbench-mados-maritime-lora-450m) | MADOS | Maritime Detection | IoU@0.5: ~2% |
41
+
42
+ ## Usage
43
+
44
+ ### With llama.cpp
45
+
46
+ ```bash
47
+ # Download Q4_K_M quantized version (recommended)
48
+ wget https://huggingface.co/5ch4um1/lfm2.5-vrsbench-lora-450m/resolve/main/lfm2.5-vrsbench-lora-450m-q4_k_m.gguf
49
+
50
+ # Run inference
51
+ ./llama-cli -m lfm2.5-vrsbench-lora-450m-q4_k_m.gguf \
52
+ --image satellite_image.jpg \
53
+ -p "Describe this satellite image in detail."
54
+ ```
55
+
56
+ ### With Transformers
57
+
58
+ ```python
59
+ from transformers import AutoModelForVision2Seq, AutoProcessor
60
+ from PIL import Image
61
+
62
+ model = AutoModelForVision2Seq.from_pretrained(
63
+ "5ch4um1/lfm2.5-vrsbench-lora-450m",
64
+ torch_dtype="auto",
65
+ device_map="auto"
66
+ )
67
+ processor = AutoProcessor.from_pretrained("5ch4um1/lfm2.5-vrsbench-lora-450m")
68
+
69
+ image = Image.open("satellite_image.jpg")
70
+ prompt = "What is shown in this satellite image?"
71
+
72
+ inputs = processor(text=prompt, images=image, return_tensors="pt").to(model.device)
73
+ outputs = model.generate(**inputs, max_new_tokens=100)
74
+ print(processor.decode(outputs[0], skip_special_tokens=True))
75
+ ```
76
+
77
+ ## GGUF Quantizations
78
+
79
+ | Version | Size | Description |
80
+ |---------|------|-------------|
81
+ | F16 | 679 MB | Full precision (16-bit) |
82
+ | Q8_0 | 362 MB | 8-bit quantization |
83
+ | Q4_K_M | 219 MB | 4-bit quantization (recommended for most use cases) |
84
+
85
+ ## Model Sources
86
+
87
+ - **Base Model**: [LiquidAI/LFM2.5-VL-450M](https://huggingface.co/LiquidAI/LFM2.5-VL-450M)
88
+ - **VRSBench Dataset**: [VRSBench Paper](https://arxiv.org/abs/)
89
+
90
+ ## Limitations
91
+
92
+ - General satellite understanding model - not specialized for specific tasks
93
+ - Performance varies depending on satellite image type and task
94
+ - For specialized tasks (terrain, maritime), use the derived expert models listed above
95
+
96
+ ## Training Environment
97
+
98
+ - **Framework**: Transformers + PEFT (LoRA)
99
+ - **Hardware**: Local GPU (CUDA)
100
+ - **Training Scripts**: Available in the [cookbook repository](https://github.com/anomalyco/opencode)