aether-raider commited on
Commit
84e2ae5
·
1 Parent(s): a85736b
Files changed (1) hide show
  1. README.md +41 -0
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ title: ATC TTS MOS Evaluation
3
+ emoji: 🎙️
4
+ colorFrom: blue
5
+ colorTo: purple
6
+ sdk: gradio
7
+ sdk_version: "4.44.0"
8
+ app_file: frontend/app.py
9
+ pinned: false
10
+ ---
11
+
12
+ # ATC TTS MOS Evaluation
13
+
14
+ An interactive evaluation interface for rating Air Traffic Control (ATC) Text-to-Speech (TTS) models using Mean Opinion Score (MOS) methodology.
15
+
16
+ ## Features
17
+
18
+ - **Sample Audio**: Listen to reference clips from different TTS models
19
+ - **MOS Rating**: Rate individual clips on clarity, pronunciation, prosody, naturalness, and overall quality
20
+ - **A/B Model Comparison**: Compare different TTS models side-by-side
21
+ - **A/B Gender Comparison**: Compare male vs female voices from the same model
22
+ - **Data Collection**: Results are automatically saved to Hugging Face datasets
23
+
24
+ ## How to Use
25
+
26
+ 1. **Introduction**: Read the evaluation guidelines
27
+ 2. **Sample Audio**: Listen to reference clips to familiarize yourself with the audio quality
28
+ 3. **MOS Rating**: Rate 18 clips across different models and speakers
29
+ 4. **Model Comparison**: Choose between different TTS models for the same content
30
+ 5. **Gender Comparison**: Compare male and female voices
31
+ 6. **Submit**: Complete the evaluation and submit your responses
32
+
33
+ ## Models Evaluated
34
+
35
+ - **CSM**: Custom Speech Model
36
+ - **XTTS**: XTTSv2 Model
37
+ - **Orpheus**: Orpheus TTS Model
38
+
39
+ ## Data Storage
40
+
41
+ All evaluation responses are stored in the `aether-raid/atc-tts-mos-ratings` dataset for research purposes.