tiantiaf commited on
Commit
2de2fd2
·
verified ·
1 Parent(s): 0103b34

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +101 -4
README.md CHANGED
@@ -1,10 +1,107 @@
1
  ---
 
 
 
 
 
 
 
 
 
 
 
2
  tags:
3
  - model_hub_mixin
4
  - pytorch_model_hub_mixin
 
 
 
 
5
  ---
6
 
7
- This model has been pushed to the Hub using the [PytorchModelHubMixin](https://huggingface.co/docs/huggingface_hub/package_reference/mixins#huggingface_hub.PyTorchModelHubMixin) integration:
8
- - Code: https://github.com/tiantiaf0627/childvox-release
9
- - Paper: [More Information Needed]
10
- - Docs: [More Information Needed]
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
  ---
2
+ base_model:
3
+ - MarvinLvn/BabyHuBERT
4
+ datasets:
5
+ - PERCEPT-R
6
+ language:
7
+ - multilingual
8
+ license: openrail
9
+ metrics:
10
+ - f1
11
+ - accuracy
12
+ pipeline_tag: audio-classification
13
  tags:
14
  - model_hub_mixin
15
  - pytorch_model_hub_mixin
16
+ - child_speech
17
+ - child_vocalization
18
+ - speech_maturity
19
+ library_name: transformers
20
  ---
21
 
22
+ # BabyHuBERT for PERCEPT-R Classification (Audio classification of /ɹ/ in children)
23
+
24
+ # Model Description
25
+ This model includes the implementation for audio classification of /ɹ/ in children described in <a href="https://arxiv.org/abs/2605.29257"><strong>**ChildVox: A Speech, Audio, and Large Audio-Language Model Benchmark in Understanding and Characterizing Sound across Childhood**</strong></a> (Accepted to EMNLP 2026 Main)
26
+
27
+ Github repository: https://github.com/tiantiaf0627/childvox-release
28
+
29
+ The model is fine-tuned on the **PERCEPT-R** dataset, a large-scale corpus for audio classification of /ɹ/ in children.
30
+
31
+ The included categories are:
32
+ ```
33
+ [
34
+ 'Derhotic',
35
+ 'Rhotic'
36
+ ]
37
+ ```
38
+
39
+ # How to use this model
40
+
41
+ ## Download repo
42
+ ```bash
43
+ git clone git@github.com:tiantiaf0627/childvox-release
44
+ ```
45
+ ## Install the package
46
+ ```bash
47
+ conda create -n childvox python=3.10
48
+ cd childvox
49
+ pip install -e .
50
+ ```
51
+
52
+ ## Load the model
53
+ ```python
54
+ # Load libraries
55
+ import torch
56
+ import torch.nn.functional as F
57
+ from src.model.childvox.hubert_audio import BabyHuBERTWrapper
58
+
59
+ # Find device
60
+ device = torch.device("cuda") if torch.cuda.is_available() else "cpu"
61
+
62
+ # Load model from Huggingface
63
+ # We provide model with different folds, and specify the fold from 1, 2, 3, 4, 5
64
+ model = BabyHuBERTWrapper.from_pretrained("tiantiaf/childvox-percet_r-babyhubert", fold_idx=1).to(device)
65
+ model.eval()
66
+ ```
67
+
68
+ ## Prediction
69
+ ```python
70
+ # Label List
71
+ label_list = [
72
+ 'Derhotic',
73
+ 'Rhotic'
74
+ ]
75
+
76
+ # Load data, here just zeros as the example
77
+ # The child word reading segments used in training are short, so we cap the input at 2 seconds
78
+ # You need to prepare your audio to a length of 2 seconds, 16kHz and mono channel
79
+ max_audio_length = 2 * 16000
80
+ data = torch.zeros([1, 160000]).float().to(device)[:, :max_audio_length]
81
+ logits, embeddings = model(data, return_feature=True)
82
+
83
+ # Probability and output
84
+ r_prob = F.softmax(logits, dim=1)
85
+ print(label_list[torch.argmax(r_prob).detach().cpu().item()])
86
+ ```
87
+
88
+ Responsible Use: Child speech data is highly sensitive. Users should respect the privacy and consent of the children and families whose recordings are processed, obtain approval from the appropriate ethics/IRB body, and adhere to the relevant laws and regulations in their jurisdictions when using ChildVox.
89
+
90
+ ## If you have any questions, please contact: Tiantian Feng (tiantiaf@usc.edu)
91
+
92
+ ❌ **Out-of-Scope Use**
93
+ - Clinical or diagnostic applications (e.g., screening for developmental or language disorders)
94
+ - Individual-level developmental assessment without expert human review
95
+ - Surveillance
96
+ - Privacy-invasive applications
97
+ - No commercial use
98
+
99
+ #### If you like our work or use the models in your work, kindly cite the following. We appreciate your recognition!
100
+ ```
101
+ @article{feng2026childvox,
102
+ title={ChildVox: A Speech, Audio, and Large Audio-Language Model Benchmark in Understanding and Characterizing Sound across Childhood},
103
+ author={Feng, Tiantian and Xu, Anfeng and Shi, Xuan and Kommineni, Aditya and Siam, Shakhrul Iman and Micheletti, Megan and Shi, Zhonghao and Tager-Flusberg, Helen and Zhang, Mi and Perry, Lynn K and others},
104
+ journal={arXiv preprint arXiv:2605.29257},
105
+ year={2026}
106
+ }
107
+ ```