Image Segmentation
ultralytics
English
Japanese
yolo
yolov11
manga
speech-bubble
segmentation
object-detection
computer-vision
Instructions to use juithealien/manga109-segmentation-bubble with libraries, inference providers, notebooks, and local apps. Follow these links to get started.
- Libraries
- ultralytics
How to use juithealien/manga109-segmentation-bubble with ultralytics:
from ultralytics import YOLOvv11 model = YOLOvv11.from_pretrained("juithealien/manga109-segmentation-bubble") source = 'http://images.cocodataset.org/val2017/000000039769.jpg' model.predict(source=source, save=True) - Notebooks
- Google Colab
- Kaggle
Commit ·
6a098fa
0
Parent(s):
Duplicate from huyvux3005/manga109-segmentation-bubble
Browse filesCo-authored-by: Vũ tiến huy <huyvux3005@users.noreply.huggingface.co>
- .gitattributes +49 -0
- BoxF1_curve.png +0 -0
- BoxPR_curve.png +0 -0
- BoxP_curve.png +0 -0
- BoxR_curve.png +0 -0
- MaskF1_curve.png +0 -0
- MaskPR_curve.png +0 -0
- MaskP_curve.png +0 -0
- MaskR_curve.png +0 -0
- README.md +248 -0
- args.yaml +106 -0
- assets/Code_Generated_Image.png +3 -0
- assets/demo1.jpg +0 -0
- assets/demo2.jpg +3 -0
- best.pt +3 -0
- confusion_matrix.png +3 -0
- confusion_matrix_normalized.png +3 -0
- labels.jpg +3 -0
- last.pt +3 -0
- results.csv +45 -0
- train_batch0.jpg +3 -0
- train_batch1.jpg +3 -0
- train_batch2.jpg +3 -0
- val_batch0_labels.jpg +3 -0
- val_batch0_pred.jpg +3 -0
- val_batch1_labels.jpg +3 -0
- val_batch1_pred.jpg +3 -0
- val_batch2_labels.jpg +3 -0
- val_batch2_pred.jpg +3 -0
.gitattributes
ADDED
|
@@ -0,0 +1,49 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
*.7z filter=lfs diff=lfs merge=lfs -text
|
| 2 |
+
*.arrow filter=lfs diff=lfs merge=lfs -text
|
| 3 |
+
*.bin filter=lfs diff=lfs merge=lfs -text
|
| 4 |
+
*.bz2 filter=lfs diff=lfs merge=lfs -text
|
| 5 |
+
*.ckpt filter=lfs diff=lfs merge=lfs -text
|
| 6 |
+
*.ftz filter=lfs diff=lfs merge=lfs -text
|
| 7 |
+
*.gz filter=lfs diff=lfs merge=lfs -text
|
| 8 |
+
*.h5 filter=lfs diff=lfs merge=lfs -text
|
| 9 |
+
*.joblib filter=lfs diff=lfs merge=lfs -text
|
| 10 |
+
*.lfs.* filter=lfs diff=lfs merge=lfs -text
|
| 11 |
+
*.mlmodel filter=lfs diff=lfs merge=lfs -text
|
| 12 |
+
*.model filter=lfs diff=lfs merge=lfs -text
|
| 13 |
+
*.msgpack filter=lfs diff=lfs merge=lfs -text
|
| 14 |
+
*.npy filter=lfs diff=lfs merge=lfs -text
|
| 15 |
+
*.npz filter=lfs diff=lfs merge=lfs -text
|
| 16 |
+
*.onnx filter=lfs diff=lfs merge=lfs -text
|
| 17 |
+
*.ot filter=lfs diff=lfs merge=lfs -text
|
| 18 |
+
*.parquet filter=lfs diff=lfs merge=lfs -text
|
| 19 |
+
*.pb filter=lfs diff=lfs merge=lfs -text
|
| 20 |
+
*.pickle filter=lfs diff=lfs merge=lfs -text
|
| 21 |
+
*.pkl filter=lfs diff=lfs merge=lfs -text
|
| 22 |
+
*.pt filter=lfs diff=lfs merge=lfs -text
|
| 23 |
+
*.pth filter=lfs diff=lfs merge=lfs -text
|
| 24 |
+
*.rar filter=lfs diff=lfs merge=lfs -text
|
| 25 |
+
*.safetensors filter=lfs diff=lfs merge=lfs -text
|
| 26 |
+
saved_model/**/* filter=lfs diff=lfs merge=lfs -text
|
| 27 |
+
*.tar.* filter=lfs diff=lfs merge=lfs -text
|
| 28 |
+
*.tar filter=lfs diff=lfs merge=lfs -text
|
| 29 |
+
*.tflite filter=lfs diff=lfs merge=lfs -text
|
| 30 |
+
*.tgz filter=lfs diff=lfs merge=lfs -text
|
| 31 |
+
*.wasm filter=lfs diff=lfs merge=lfs -text
|
| 32 |
+
*.xz filter=lfs diff=lfs merge=lfs -text
|
| 33 |
+
*.zip filter=lfs diff=lfs merge=lfs -text
|
| 34 |
+
*.zst filter=lfs diff=lfs merge=lfs -text
|
| 35 |
+
*tfevents* filter=lfs diff=lfs merge=lfs -text
|
| 36 |
+
assets/Code_Generated_Image.png filter=lfs diff=lfs merge=lfs -text
|
| 37 |
+
assets/demo2.jpg filter=lfs diff=lfs merge=lfs -text
|
| 38 |
+
confusion_matrix_normalized.png filter=lfs diff=lfs merge=lfs -text
|
| 39 |
+
confusion_matrix.png filter=lfs diff=lfs merge=lfs -text
|
| 40 |
+
labels.jpg filter=lfs diff=lfs merge=lfs -text
|
| 41 |
+
train_batch0.jpg filter=lfs diff=lfs merge=lfs -text
|
| 42 |
+
train_batch1.jpg filter=lfs diff=lfs merge=lfs -text
|
| 43 |
+
train_batch2.jpg filter=lfs diff=lfs merge=lfs -text
|
| 44 |
+
val_batch0_labels.jpg filter=lfs diff=lfs merge=lfs -text
|
| 45 |
+
val_batch0_pred.jpg filter=lfs diff=lfs merge=lfs -text
|
| 46 |
+
val_batch1_labels.jpg filter=lfs diff=lfs merge=lfs -text
|
| 47 |
+
val_batch1_pred.jpg filter=lfs diff=lfs merge=lfs -text
|
| 48 |
+
val_batch2_labels.jpg filter=lfs diff=lfs merge=lfs -text
|
| 49 |
+
val_batch2_pred.jpg filter=lfs diff=lfs merge=lfs -text
|
BoxF1_curve.png
ADDED
|
BoxPR_curve.png
ADDED
|
BoxP_curve.png
ADDED
|
BoxR_curve.png
ADDED
|
MaskF1_curve.png
ADDED
|
MaskPR_curve.png
ADDED
|
MaskP_curve.png
ADDED
|
MaskR_curve.png
ADDED
|
README.md
ADDED
|
@@ -0,0 +1,248 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
---
|
| 2 |
+
license: apache-2.0
|
| 3 |
+
language:
|
| 4 |
+
- en
|
| 5 |
+
- ja
|
| 6 |
+
tags:
|
| 7 |
+
- yolo
|
| 8 |
+
- yolov11
|
| 9 |
+
- ultralytics
|
| 10 |
+
- manga
|
| 11 |
+
- speech-bubble
|
| 12 |
+
- segmentation
|
| 13 |
+
- object-detection
|
| 14 |
+
- computer-vision
|
| 15 |
+
- image-segmentation
|
| 16 |
+
datasets:
|
| 17 |
+
- MS92/MangaSegmentation
|
| 18 |
+
- manga109
|
| 19 |
+
pipeline_tag: image-segmentation
|
| 20 |
+
library_name: ultralytics
|
| 21 |
+
---
|
| 22 |
+
|
| 23 |
+
# 🎯 MangaLens - Manga Speech Bubble Segmentation
|
| 24 |
+
|
| 25 |
+
<div align="center">
|
| 26 |
+
|
| 27 |
+

|
| 28 |
+

|
| 29 |
+

|
| 30 |
+

|
| 31 |
+
|
| 32 |
+
</div>
|
| 33 |
+
|
| 34 |
+
A high-performance YOLO11n instance segmentation model fine-tuned for detecting and segmenting speech bubbles in manga/comic images.
|
| 35 |
+
|
| 36 |
+
## �️ Demo Results
|
| 37 |
+
|
| 38 |
+
<div align="center">
|
| 39 |
+
|
| 40 |
+
| Detection on Various Manga Styles |
|
| 41 |
+
|:--:|
|
| 42 |
+
|  |
|
| 43 |
+
| *Speech bubble detection on action manga with multiple bubbles* |
|
| 44 |
+
|
| 45 |
+
|  |
|
| 46 |
+
|:--:|
|
| 47 |
+
| *Detection on slice-of-life manga style* |
|
| 48 |
+
|
| 49 |
+
</div>
|
| 50 |
+
|
| 51 |
+
## �📊 Model Performance
|
| 52 |
+
|
| 53 |
+
### Final Evaluation Results (Epoch 44)
|
| 54 |
+
|
| 55 |
+
| Metric | Box Detection | Mask Segmentation |
|
| 56 |
+
|--------|---------------|-------------------|
|
| 57 |
+
| **Precision** | 97.55% | 97.66% |
|
| 58 |
+
| **Recall** | 97.03% | 97.15% |
|
| 59 |
+
| **mAP@50** | 99.10% | 99.13% |
|
| 60 |
+
| **mAP@50-95** | 96.67% | 94.69% |
|
| 61 |
+
|
| 62 |
+
### Training Curves
|
| 63 |
+
|
| 64 |
+
<div align="center">
|
| 65 |
+
|
| 66 |
+

|
| 67 |
+
*Left: Segmentation Loss (Train vs Val) | Right: Mask mAP Metrics over epochs*
|
| 68 |
+
|
| 69 |
+
</div>
|
| 70 |
+
|
| 71 |
+
| Loss Type | Final Value |
|
| 72 |
+
|-----------|-------------|
|
| 73 |
+
| Box Loss | 0.2499 |
|
| 74 |
+
| Segmentation Loss | 0.2762 |
|
| 75 |
+
| Classification Loss | 0.2109 |
|
| 76 |
+
| DFL Loss | 0.8064 |
|
| 77 |
+
|
| 78 |
+
## 🎓 Training Configuration
|
| 79 |
+
|
| 80 |
+
| Parameter | Value |
|
| 81 |
+
|-----------|-------|
|
| 82 |
+
| Base Model | `yolo11n-seg.pt` |
|
| 83 |
+
| Image Size | 1600×1600 |
|
| 84 |
+
| Batch Size | 8 |
|
| 85 |
+
| Epochs | 100 (Early stopped at 44) |
|
| 86 |
+
| Optimizer | Auto (AdamW) |
|
| 87 |
+
| Learning Rate | 0.01 |
|
| 88 |
+
| Weight Decay | 0.0005 |
|
| 89 |
+
| Patience | 10 |
|
| 90 |
+
| AMP | Enabled |
|
| 91 |
+
|
| 92 |
+
### Data Augmentation
|
| 93 |
+
|
| 94 |
+
- HSV Augmentation: H=0.015, S=0.7, V=0.4
|
| 95 |
+
- Mosaic: 1.0
|
| 96 |
+
- Flip Left-Right: 0.5
|
| 97 |
+
- Scale: 0.5
|
| 98 |
+
- Translate: 0.1
|
| 99 |
+
|
| 100 |
+
## 📚 Training Data
|
| 101 |
+
|
| 102 |
+
This model was trained on a combined dataset of:
|
| 103 |
+
|
| 104 |
+
1. **[MS92/MangaSegmentation](https://huggingface.co/datasets/MS92/MangaSegmentation)** - Manga panel and bubble segmentation dataset
|
| 105 |
+
2. **[Manga109](http://www.manga109.org/)** - Large-scale manga dataset with speech bubble annotations
|
| 106 |
+
|
| 107 |
+
## 🚀 Quick Start
|
| 108 |
+
|
| 109 |
+
### Installation
|
| 110 |
+
|
| 111 |
+
```bash
|
| 112 |
+
pip install ultralytics>=8.0.0
|
| 113 |
+
```
|
| 114 |
+
|
| 115 |
+
### Inference
|
| 116 |
+
|
| 117 |
+
```python
|
| 118 |
+
from ultralytics import YOLO
|
| 119 |
+
|
| 120 |
+
# Load the model
|
| 121 |
+
model = YOLO("best.pt")
|
| 122 |
+
|
| 123 |
+
# Run inference on an image
|
| 124 |
+
results = model("manga_page.jpg")
|
| 125 |
+
|
| 126 |
+
# Process results
|
| 127 |
+
for result in results:
|
| 128 |
+
# Get bounding boxes
|
| 129 |
+
boxes = result.boxes
|
| 130 |
+
|
| 131 |
+
# Get segmentation masks
|
| 132 |
+
masks = result.masks
|
| 133 |
+
|
| 134 |
+
# Visualize results
|
| 135 |
+
result.show()
|
| 136 |
+
|
| 137 |
+
# Save results
|
| 138 |
+
result.save("output.jpg")
|
| 139 |
+
```
|
| 140 |
+
|
| 141 |
+
### Batch Processing
|
| 142 |
+
|
| 143 |
+
```python
|
| 144 |
+
from ultralytics import YOLO
|
| 145 |
+
from pathlib import Path
|
| 146 |
+
|
| 147 |
+
model = YOLO("best.pt")
|
| 148 |
+
|
| 149 |
+
# Process multiple images
|
| 150 |
+
image_folder = Path("manga_pages/")
|
| 151 |
+
results = model(list(image_folder.glob("*.jpg")), stream=True)
|
| 152 |
+
|
| 153 |
+
for i, result in enumerate(results):
|
| 154 |
+
result.save(f"output_{i}.jpg")
|
| 155 |
+
```
|
| 156 |
+
|
| 157 |
+
### Extract Bubble Regions
|
| 158 |
+
|
| 159 |
+
```python
|
| 160 |
+
import cv2
|
| 161 |
+
import numpy as np
|
| 162 |
+
from ultralytics import YOLO
|
| 163 |
+
|
| 164 |
+
model = YOLO("best.pt")
|
| 165 |
+
image = cv2.imread("manga_page.jpg")
|
| 166 |
+
results = model(image)[0]
|
| 167 |
+
|
| 168 |
+
# Extract each bubble as a separate image
|
| 169 |
+
for i, mask in enumerate(results.masks.data):
|
| 170 |
+
mask_np = mask.cpu().numpy()
|
| 171 |
+
mask_resized = cv2.resize(mask_np, (image.shape[1], image.shape[0]))
|
| 172 |
+
|
| 173 |
+
# Apply mask
|
| 174 |
+
bubble = image.copy()
|
| 175 |
+
bubble[mask_resized < 0.5] = 0
|
| 176 |
+
|
| 177 |
+
# Get bounding box and crop
|
| 178 |
+
coords = np.where(mask_resized >= 0.5)
|
| 179 |
+
if len(coords[0]) > 0:
|
| 180 |
+
y_min, y_max = coords[0].min(), coords[0].max()
|
| 181 |
+
x_min, x_max = coords[1].min(), coords[1].max()
|
| 182 |
+
cropped = bubble[y_min:y_max, x_min:x_max]
|
| 183 |
+
cv2.imwrite(f"bubble_{i}.png", cropped)
|
| 184 |
+
```
|
| 185 |
+
|
| 186 |
+
## 📁 Model Files
|
| 187 |
+
|
| 188 |
+
```
|
| 189 |
+
weights/
|
| 190 |
+
├── best.pt # Best checkpoint (recommended)
|
| 191 |
+
└── last.pt # Last training checkpoint
|
| 192 |
+
```
|
| 193 |
+
|
| 194 |
+
## 🎯 Use Cases
|
| 195 |
+
|
| 196 |
+
- **Manga Translation**: Automatically detect speech bubbles for text extraction and translation
|
| 197 |
+
- **Manga Analysis**: Study panel layouts and dialogue distribution
|
| 198 |
+
- **Content Moderation**: Identify and process text regions in comics
|
| 199 |
+
- **Accessibility**: Enable text-to-speech for manga readers
|
| 200 |
+
- **Dataset Creation**: Generate annotations for manga datasets
|
| 201 |
+
|
| 202 |
+
## ⚙️ Technical Details
|
| 203 |
+
|
| 204 |
+
### Model Architecture
|
| 205 |
+
|
| 206 |
+
- **Backbone**: YOLO11n (Nano variant)
|
| 207 |
+
- **Task**: Instance Segmentation
|
| 208 |
+
- **Classes**: 1 (Speech Bubble)
|
| 209 |
+
- **Input**: RGB images (any size, recommended 1600×1600)
|
| 210 |
+
- **Output**: Bounding boxes + Instance masks
|
| 211 |
+
|
| 212 |
+
### Inference Speed
|
| 213 |
+
|
| 214 |
+
| Device | Speed (ms/image) |
|
| 215 |
+
|--------|------------------|
|
| 216 |
+
| GPU (T4) | ~15-25 ms |
|
| 217 |
+
| GPU (V100) | ~8-12 ms |
|
| 218 |
+
| CPU | ~200-400 ms |
|
| 219 |
+
|
| 220 |
+
## 📝 Citation
|
| 221 |
+
|
| 222 |
+
If you use this model in your research, please cite:
|
| 223 |
+
|
| 224 |
+
```bibtex
|
| 225 |
+
@misc{mangalens2024,
|
| 226 |
+
title={MangaLens: YOLO11n Speech Bubble Segmentation Model},
|
| 227 |
+
author={MangaLens Team},
|
| 228 |
+
year={2024},
|
| 229 |
+
publisher={Hugging Face},
|
| 230 |
+
url={https://huggingface.co/your-username/mangalens-bubble-segmentation}
|
| 231 |
+
}
|
| 232 |
+
```
|
| 233 |
+
|
| 234 |
+
## 📜 License
|
| 235 |
+
|
| 236 |
+
This model is released under the [Apache 2.0 License](LICENSE).
|
| 237 |
+
|
| 238 |
+
## 🙏 Acknowledgements
|
| 239 |
+
|
| 240 |
+
- [Ultralytics](https://ultralytics.com/) for the YOLO framework
|
| 241 |
+
- [MS92/MangaSegmentation](https://huggingface.co/datasets/MS92/MangaSegmentation) dataset
|
| 242 |
+
- [Manga109](http://www.manga109.org/) dataset
|
| 243 |
+
|
| 244 |
+
---
|
| 245 |
+
|
| 246 |
+
<div align="center">
|
| 247 |
+
<b>Made with ❤️ for the manga community</b>
|
| 248 |
+
</div>
|
args.yaml
ADDED
|
@@ -0,0 +1,106 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
task: segment
|
| 2 |
+
mode: train
|
| 3 |
+
model: yolo11n-seg.pt
|
| 4 |
+
data: /content/dataset/data/YOLO_data/dataset.yaml
|
| 5 |
+
epochs: 100
|
| 6 |
+
time: null
|
| 7 |
+
patience: 10
|
| 8 |
+
batch: 8
|
| 9 |
+
imgsz: 1600
|
| 10 |
+
save: true
|
| 11 |
+
save_period: -1
|
| 12 |
+
cache: false
|
| 13 |
+
device: null
|
| 14 |
+
workers: 8
|
| 15 |
+
project: /content/dataset/models/bubble-detection/YOLOv11n_Training_Results
|
| 16 |
+
name: balloon_segmentation_run1
|
| 17 |
+
exist_ok: true
|
| 18 |
+
pretrained: true
|
| 19 |
+
optimizer: auto
|
| 20 |
+
verbose: true
|
| 21 |
+
seed: 0
|
| 22 |
+
deterministic: true
|
| 23 |
+
single_cls: false
|
| 24 |
+
rect: false
|
| 25 |
+
cos_lr: false
|
| 26 |
+
close_mosaic: 10
|
| 27 |
+
resume: false
|
| 28 |
+
amp: true
|
| 29 |
+
fraction: 1.0
|
| 30 |
+
profile: false
|
| 31 |
+
freeze: null
|
| 32 |
+
multi_scale: false
|
| 33 |
+
compile: false
|
| 34 |
+
overlap_mask: true
|
| 35 |
+
mask_ratio: 4
|
| 36 |
+
dropout: 0.0
|
| 37 |
+
val: true
|
| 38 |
+
split: val
|
| 39 |
+
save_json: false
|
| 40 |
+
conf: null
|
| 41 |
+
iou: 0.7
|
| 42 |
+
max_det: 300
|
| 43 |
+
half: false
|
| 44 |
+
dnn: false
|
| 45 |
+
plots: true
|
| 46 |
+
source: null
|
| 47 |
+
vid_stride: 1
|
| 48 |
+
stream_buffer: false
|
| 49 |
+
visualize: false
|
| 50 |
+
augment: false
|
| 51 |
+
agnostic_nms: false
|
| 52 |
+
classes: null
|
| 53 |
+
retina_masks: false
|
| 54 |
+
embed: null
|
| 55 |
+
show: false
|
| 56 |
+
save_frames: false
|
| 57 |
+
save_txt: false
|
| 58 |
+
save_conf: false
|
| 59 |
+
save_crop: false
|
| 60 |
+
show_labels: true
|
| 61 |
+
show_conf: true
|
| 62 |
+
show_boxes: true
|
| 63 |
+
line_width: null
|
| 64 |
+
format: torchscript
|
| 65 |
+
keras: false
|
| 66 |
+
optimize: false
|
| 67 |
+
int8: false
|
| 68 |
+
dynamic: false
|
| 69 |
+
simplify: true
|
| 70 |
+
opset: null
|
| 71 |
+
workspace: null
|
| 72 |
+
nms: false
|
| 73 |
+
lr0: 0.01
|
| 74 |
+
lrf: 0.01
|
| 75 |
+
momentum: 0.937
|
| 76 |
+
weight_decay: 0.0005
|
| 77 |
+
warmup_epochs: 3.0
|
| 78 |
+
warmup_momentum: 0.8
|
| 79 |
+
warmup_bias_lr: 0.1
|
| 80 |
+
box: 7.5
|
| 81 |
+
cls: 0.5
|
| 82 |
+
dfl: 1.5
|
| 83 |
+
pose: 12.0
|
| 84 |
+
kobj: 1.0
|
| 85 |
+
nbs: 64
|
| 86 |
+
hsv_h: 0.015
|
| 87 |
+
hsv_s: 0.7
|
| 88 |
+
hsv_v: 0.4
|
| 89 |
+
degrees: 0.0
|
| 90 |
+
translate: 0.1
|
| 91 |
+
scale: 0.5
|
| 92 |
+
shear: 0.0
|
| 93 |
+
perspective: 0.0
|
| 94 |
+
flipud: 0.0
|
| 95 |
+
fliplr: 0.5
|
| 96 |
+
bgr: 0.0
|
| 97 |
+
mosaic: 1.0
|
| 98 |
+
mixup: 0.0
|
| 99 |
+
cutmix: 0.0
|
| 100 |
+
copy_paste: 0.0
|
| 101 |
+
copy_paste_mode: flip
|
| 102 |
+
auto_augment: randaugment
|
| 103 |
+
erasing: 0.4
|
| 104 |
+
cfg: null
|
| 105 |
+
tracker: botsort.yaml
|
| 106 |
+
save_dir: /content/dataset/models/bubble-detection/YOLOv11n_Training_Results/balloon_segmentation_run1
|
assets/Code_Generated_Image.png
ADDED
|
Git LFS Details
|
assets/demo1.jpg
ADDED
|
assets/demo2.jpg
ADDED
|
Git LFS Details
|
best.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:4028152940f7c910f40192f46ede3b3f6c7129e5c76849c324d3564f8ac50198
|
| 3 |
+
size 12003405
|
confusion_matrix.png
ADDED
|
Git LFS Details
|
confusion_matrix_normalized.png
ADDED
|
Git LFS Details
|
labels.jpg
ADDED
|
Git LFS Details
|
last.pt
ADDED
|
@@ -0,0 +1,3 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
version https://git-lfs.github.com/spec/v1
|
| 2 |
+
oid sha256:9d672ebdd8b620c12e40e4a48460c80b49f63ce349a36cfd732df55f3c408275
|
| 3 |
+
size 12003597
|
results.csv
ADDED
|
@@ -0,0 +1,45 @@
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
|
| 1 |
+
epoch,time,train/box_loss,train/seg_loss,train/cls_loss,train/dfl_loss,metrics/precision(B),metrics/recall(B),metrics/mAP50(B),metrics/mAP50-95(B),metrics/precision(M),metrics/recall(M),metrics/mAP50(M),metrics/mAP50-95(M),val/box_loss,val/seg_loss,val/cls_loss,val/dfl_loss,lr/pg0,lr/pg1,lr/pg2
|
| 2 |
+
1,706.914,0.43378,0.55952,0.94032,0.84951,0.96054,0.95637,0.97894,0.9071,0.96358,0.95622,0.98092,0.89872,0.35756,0.42317,0.41822,0.81485,0.00333,0.00333,0.00333
|
| 3 |
+
2,1361.13,0.42427,0.4244,0.50122,0.83991,0.96653,0.95808,0.98334,0.91977,0.968,0.95954,0.98491,0.90478,0.35019,0.38284,0.33781,0.81813,0.00659737,0.00659737,0.00659737
|
| 4 |
+
3,2014.13,0.44112,0.38538,0.43594,0.84968,0.96687,0.95828,0.98265,0.92678,0.96842,0.95966,0.98408,0.92819,0.31968,0.38892,0.31273,0.82727,0.00979874,0.00979874,0.00979874
|
| 5 |
+
4,2659.63,0.42057,0.37253,0.39391,0.84975,0.96541,0.95714,0.97985,0.93136,0.96716,0.95887,0.98103,0.92225,0.30704,0.37096,0.31428,0.82207,0.009703,0.009703,0.009703
|
| 6 |
+
5,3300.33,0.38289,0.35865,0.3545,0.8427,0.96834,0.96002,0.98567,0.94145,0.96969,0.96137,0.98659,0.92986,0.28652,0.37294,0.2805,0.81816,0.009604,0.009604,0.009604
|
| 7 |
+
6,3940.1,0.36158,0.35068,0.32936,0.83751,0.96953,0.96302,0.98563,0.94266,0.971,0.9644,0.98678,0.9186,0.28929,0.3859,0.26893,0.8221,0.009505,0.009505,0.009505
|
| 8 |
+
7,4579.28,0.34761,0.34673,0.31752,0.83489,0.97073,0.96022,0.98556,0.94799,0.972,0.9611,0.98618,0.9318,0.27398,0.36396,0.26311,0.81297,0.009406,0.009406,0.009406
|
| 9 |
+
8,5218.3,0.33715,0.34116,0.30638,0.83201,0.97004,0.96748,0.98778,0.94922,0.97155,0.96922,0.98879,0.93211,0.27091,0.36204,0.24675,0.81537,0.009307,0.009307,0.009307
|
| 10 |
+
9,5856.42,0.32716,0.32776,0.29629,0.8295,0.96957,0.96791,0.98833,0.95391,0.97114,0.96924,0.98893,0.93826,0.25602,0.34473,0.24038,0.80953,0.009208,0.009208,0.009208
|
| 11 |
+
10,6498.28,0.31999,0.32391,0.28755,0.82673,0.97196,0.96202,0.98667,0.95177,0.97323,0.9629,0.98751,0.93728,0.25663,0.34996,0.23957,0.81071,0.009109,0.009109,0.009109
|
| 12 |
+
11,7140.77,0.31266,0.31989,0.28081,0.82496,0.96995,0.96736,0.98928,0.95594,0.97114,0.96855,0.9899,0.93418,0.24816,0.3437,0.2266,0.8083,0.00901,0.00901,0.00901
|
| 13 |
+
12,7781.02,0.31,0.32526,0.27707,0.82441,0.96873,0.96843,0.98879,0.95566,0.96982,0.96955,0.98928,0.93415,0.25108,0.33794,0.22936,0.80756,0.008911,0.008911,0.008911
|
| 14 |
+
13,8421.45,0.30195,0.30923,0.27101,0.82359,0.97001,0.96638,0.98833,0.95551,0.97094,0.96741,0.9889,0.93836,0.25044,0.33709,0.22602,0.80631,0.008812,0.008812,0.008812
|
| 15 |
+
14,9058.92,0.30178,0.31828,0.26952,0.82364,0.9697,0.97147,0.98941,0.95605,0.97065,0.97279,0.9899,0.94081,0.2454,0.33441,0.21781,0.80502,0.008713,0.008713,0.008713
|
| 16 |
+
15,9700.04,0.29717,0.31329,0.26244,0.82064,0.96828,0.96943,0.98897,0.95627,0.96935,0.97058,0.98957,0.93523,0.24471,0.32999,0.21663,0.8076,0.008614,0.008614,0.008614
|
| 17 |
+
16,10339.4,0.29183,0.30715,0.25872,0.82004,0.9694,0.96477,0.98837,0.95511,0.97072,0.96586,0.9889,0.93815,0.24541,0.33798,0.22149,0.80561,0.008515,0.008515,0.008515
|
| 18 |
+
17,10977.9,0.28992,0.30563,0.25627,0.81989,0.97133,0.96928,0.98978,0.95939,0.97225,0.97043,0.99034,0.94082,0.23864,0.32715,0.21147,0.80359,0.008416,0.008416,0.008416
|
| 19 |
+
18,11620.2,0.28652,0.30408,0.25332,0.81796,0.96904,0.96647,0.98879,0.95525,0.97001,0.96801,0.98945,0.93956,0.24419,0.33634,0.21458,0.80645,0.008317,0.008317,0.008317
|
| 20 |
+
19,12262.6,0.28711,0.30675,0.25137,0.81823,0.97047,0.96816,0.99001,0.95797,0.97002,0.97054,0.99049,0.94056,0.23781,0.32563,0.20886,0.80285,0.008218,0.008218,0.008218
|
| 21 |
+
20,12902.5,0.28014,0.30095,0.24556,0.81618,0.97266,0.96609,0.98976,0.95824,0.97424,0.96709,0.99027,0.93816,0.2391,0.32455,0.208,0.80456,0.008119,0.008119,0.008119
|
| 22 |
+
21,13542,0.27967,0.29931,0.24745,0.8169,0.97386,0.96735,0.98984,0.95996,0.97518,0.96866,0.99022,0.94391,0.23344,0.3186,0.20319,0.80025,0.00802,0.00802,0.00802
|
| 23 |
+
22,14182,0.27693,0.29394,0.24185,0.81444,0.96979,0.97081,0.98915,0.96012,0.97116,0.97193,0.98963,0.94477,0.23577,0.33233,0.20281,0.80219,0.007921,0.007921,0.007921
|
| 24 |
+
23,14819.5,0.27726,0.29894,0.24189,0.81573,0.97285,0.97031,0.99026,0.96041,0.97393,0.97128,0.99073,0.94403,0.23351,0.32471,0.20129,0.79972,0.007822,0.007822,0.007822
|
| 25 |
+
24,15457.9,0.27383,0.29854,0.23887,0.81483,0.97138,0.97035,0.99005,0.9616,0.97244,0.97164,0.99045,0.94141,0.23658,0.32406,0.20402,0.80129,0.007723,0.007723,0.007723
|
| 26 |
+
25,16099.3,0.27308,0.29582,0.23663,0.81324,0.97354,0.97212,0.99044,0.96229,0.97462,0.97327,0.99088,0.94203,0.23172,0.32007,0.19582,0.79917,0.007624,0.007624,0.007624
|
| 27 |
+
26,16741.3,0.27247,0.29597,0.23654,0.81357,0.97377,0.9715,0.99027,0.96225,0.97488,0.97262,0.99071,0.94404,0.23076,0.32353,0.19355,0.80115,0.007525,0.007525,0.007525
|
| 28 |
+
27,17379.4,0.26702,0.28739,0.23112,0.81183,0.96844,0.97304,0.99052,0.9614,0.96948,0.97408,0.99091,0.9424,0.22772,0.31785,0.19541,0.79888,0.007426,0.007426,0.007426
|
| 29 |
+
28,18018.3,0.2661,0.28532,0.23023,0.81216,0.97221,0.97009,0.99052,0.96226,0.9736,0.97166,0.99098,0.94443,0.2282,0.3222,0.19185,0.79942,0.007327,0.007327,0.007327
|
| 30 |
+
29,18658.9,0.26802,0.29301,0.22875,0.81257,0.97206,0.97296,0.9903,0.96188,0.97322,0.97412,0.99064,0.94451,0.22944,0.32056,0.19007,0.80025,0.007228,0.007228,0.007228
|
| 31 |
+
30,19297.4,0.26485,0.29027,0.22844,0.81118,0.97195,0.97185,0.99036,0.96286,0.9728,0.97289,0.99079,0.9425,0.22513,0.31872,0.18949,0.79772,0.007129,0.007129,0.007129
|
| 32 |
+
31,19937.5,0.26529,0.28966,0.2306,0.81165,0.9753,0.96903,0.99032,0.96367,0.97638,0.9701,0.99096,0.94497,0.22609,0.31528,0.18934,0.79789,0.00703,0.00703,0.00703
|
| 33 |
+
32,20577.3,0.26367,0.29025,0.22882,0.8127,0.97391,0.97097,0.99072,0.96479,0.97502,0.97208,0.99119,0.9445,0.22657,0.3138,0.18892,0.79899,0.006931,0.006931,0.006931
|
| 34 |
+
33,21214.9,0.26166,0.28526,0.22319,0.81138,0.9724,0.97294,0.99043,0.96354,0.97367,0.97331,0.99084,0.94649,0.22692,0.313,0.18777,0.7997,0.006832,0.006832,0.006832
|
| 35 |
+
34,21854.2,0.26097,0.2839,0.22415,0.81014,0.97368,0.97301,0.99089,0.9652,0.97483,0.97416,0.9913,0.94444,0.22449,0.31274,0.18493,0.79765,0.006733,0.006733,0.006733
|
| 36 |
+
35,22492.9,0.25903,0.28433,0.22269,0.80964,0.97238,0.9735,0.99072,0.96542,0.97393,0.97398,0.99106,0.94636,0.22317,0.31174,0.18391,0.79733,0.006634,0.006634,0.006634
|
| 37 |
+
36,23134.1,0.25669,0.28064,0.21938,0.81017,0.97294,0.97207,0.99069,0.96413,0.97396,0.97362,0.99098,0.94752,0.22351,0.3139,0.18603,0.79812,0.006535,0.006535,0.006535
|
| 38 |
+
37,23775.1,0.25709,0.2828,0.21925,0.80966,0.97414,0.9725,0.99056,0.96419,0.97521,0.97358,0.99086,0.94534,0.22187,0.31127,0.18199,0.79675,0.006436,0.006436,0.006436
|
| 39 |
+
38,24416.2,0.25534,0.28095,0.21923,0.80983,0.97231,0.97375,0.99107,0.96553,0.9736,0.97469,0.99138,0.94709,0.22197,0.31006,0.1822,0.7974,0.006337,0.006337,0.006337
|
| 40 |
+
39,25055.5,0.25385,0.28204,0.21718,0.80842,0.97327,0.97326,0.99093,0.9646,0.97435,0.97453,0.9913,0.94731,0.22178,0.30949,0.18033,0.79687,0.006238,0.006238,0.006238
|
| 41 |
+
40,25696.3,0.25484,0.28016,0.21472,0.80866,0.97431,0.97448,0.99081,0.96623,0.97546,0.97563,0.99126,0.9457,0.22261,0.31212,0.17848,0.79729,0.006139,0.006139,0.006139
|
| 42 |
+
41,26336.1,0.25291,0.27876,0.21371,0.80768,0.9716,0.97608,0.99072,0.96599,0.97267,0.97715,0.99119,0.9468,0.22083,0.31037,0.17897,0.79711,0.00604,0.00604,0.00604
|
| 43 |
+
42,26975.1,0.25163,0.2784,0.21355,0.80829,0.97445,0.97231,0.99106,0.96629,0.9756,0.97338,0.99136,0.94825,0.21977,0.30901,0.17985,0.79669,0.005941,0.005941,0.005941
|
| 44 |
+
43,27615,0.25159,0.27702,0.21213,0.80805,0.97368,0.97477,0.99101,0.96698,0.97465,0.97615,0.99139,0.94776,0.21959,0.30982,0.1754,0.79569,0.005842,0.005842,0.005842
|
| 45 |
+
44,28257.4,0.24987,0.27617,0.21094,0.80642,0.97545,0.9703,0.99102,0.96667,0.97664,0.97149,0.99134,0.94687,0.21922,0.30878,0.17733,0.79485,0.005743,0.005743,0.005743
|
train_batch0.jpg
ADDED
|
Git LFS Details
|
train_batch1.jpg
ADDED
|
Git LFS Details
|
train_batch2.jpg
ADDED
|
Git LFS Details
|
val_batch0_labels.jpg
ADDED
|
Git LFS Details
|
val_batch0_pred.jpg
ADDED
|
Git LFS Details
|
val_batch1_labels.jpg
ADDED
|
Git LFS Details
|
val_batch1_pred.jpg
ADDED
|
Git LFS Details
|
val_batch2_labels.jpg
ADDED
|
Git LFS Details
|
val_batch2_pred.jpg
ADDED
|
Git LFS Details
|