Hugging Face's logo

pk1308
/
23f2000254-t12026-genre-classifier

Audio Classification
English
music-genre-classification
transformer
cqt
mel-spectrogram
Model card Files
xet
 Community
pk1308 commited on
Commit
5d05499
·
verified ·
1 Parent(s): 9469e32

Upload folder using huggingface_hub

Browse files
Files changed (5) hide show
  1. README.md +41 -0
  2. best_model.pt +3 -0
  3. checkpoint_epoch_10.pt +3 -0
  4. checkpoint_epoch_20.pt +3 -0
  5. history.json +191 -0
README.md ADDED
@@ -0,0 +1,41 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ ---
2
+ language: en
3
+ license: mit
4
+ tags:
5
+ - audio-classification
6
+ - music-genre-classification
7
+ - transformer
8
+ - cqt
9
+ - mel-spectrogram
10
+ datasets:
11
+ - synthetic-mashups-gtzan
12
+ metrics:
13
+ - accuracy
14
+ - f1-score
15
+ ---
16
+
17
+ # Music Genre Classifier - 23f2000254-t12026
18
+
19
+ Hierarchical Vision Transformer for music genre classification using Mel spectrogram and CQT features.
20
+
21
+ ## Model Architecture
22
+
23
+ - **Type**: Hierarchical Vision Transformer (ViT)
24
+ - **Input**: 7-second audio segments with 2-second overlap (6 segments)
25
+ - **Features**:
26
+ - Mel spectrogram (128 bins)
27
+ - Constant-Q Transform (84 bins)
28
+ - **Encoder**: Factorized attention with 256 embed dim, 8 heads, 4 layers
29
+ - **Temporal**: Transformer encoder with CLS token aggregation
30
+
31
+ ## Training Details
32
+
33
+ - **Dataset**: 10,000 synthetic mashups (GTZAN-based)
34
+ - **Classes**: 10 genres (blues, classical, country, disco, hiphop, jazz, metal, pop, reggae, rock)
35
+ - **Best Val F1**: 0.763
36
+ - **Best Val Accuracy**: 76.6%
37
+
38
+ ## Files
39
+
40
+ - `best_model.pt`: Model checkpoint with weights, config, and genre mapping
41
+ - `history.json`: Training history
best_model.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8d1554fddd55afb29b060a06f78c38ff3c11e1e3462cfe776ea5d2a5b7ac5585
3
+ size 78906312
checkpoint_epoch_10.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:a9ccd1fb73d599fb8e792f7a5bda652009fde597f861e87a3ec7e98ba3a4167a
3
+ size 78907949
checkpoint_epoch_20.pt ADDED
@@ -0,0 +1,3 @@
 
 
 
 
1
+ version https://git-lfs.github.com/spec/v1
2
+ oid sha256:8f91b3e4e8e2da94e5d6e848e6e695900e27384463cff83782b631df43f09e3d
3
+ size 78907949
history.json ADDED
@@ -0,0 +1,191 @@
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
1
+ [
2
+ {
3
+ "epoch": 1,
4
+ "train_loss": 1.8634616331865559,
5
+ "train_acc": 0.3714689265536723,
6
+ "val_loss": 1.4821701671214813,
7
+ "val_acc": 0.5753333333333334,
8
+ "val_f1": 0.553344354122674,
9
+ "lr": 5e-05
10
+ },
11
+ {
12
+ "epoch": 2,
13
+ "train_loss": 1.4907357022587189,
14
+ "train_acc": 0.561087570621469,
15
+ "val_loss": 1.3370061538954998,
16
+ "val_acc": 0.6546666666666666,
17
+ "val_f1": 0.6355805584322811,
18
+ "lr": 0.0001
19
+ },
20
+ {
21
+ "epoch": 3,
22
+ "train_loss": 1.2910220716183693,
23
+ "train_acc": 0.658427495291902,
24
+ "val_loss": 1.2559079502491242,
25
+ "val_acc": 0.6946666666666667,
26
+ "val_f1": 0.6857755034625004,
27
+ "lr": 0.00015
28
+ },
29
+ {
30
+ "epoch": 4,
31
+ "train_loss": 1.189677392807833,
32
+ "train_acc": 0.7016242937853108,
33
+ "val_loss": 1.2796474888603737,
34
+ "val_acc": 0.6686666666666666,
35
+ "val_f1": 0.6653552496615758,
36
+ "lr": 0.0002
37
+ },
38
+ {
39
+ "epoch": 5,
40
+ "train_loss": 1.1324563969326558,
41
+ "train_acc": 0.7279896421845574,
42
+ "val_loss": 1.2890468131988606,
43
+ "val_acc": 0.684,
44
+ "val_f1": 0.6694319101383398,
45
+ "lr": 0.00025
46
+ },
47
+ {
48
+ "epoch": 6,
49
+ "train_loss": 1.1166650506960694,
50
+ "train_acc": 0.7368173258003766,
51
+ "val_loss": 1.0854211405236671,
52
+ "val_acc": 0.766,
53
+ "val_f1": 0.7630987775807697,
54
+ "lr": 0.0003
55
+ },
56
+ {
57
+ "epoch": 7,
58
+ "train_loss": 1.1314916518672935,
59
+ "train_acc": 0.7330508474576272,
60
+ "val_loss": 1.1521067020106823,
61
+ "val_acc": 0.7453333333333333,
62
+ "val_f1": 0.743024517411605,
63
+ "lr": 0.00035
64
+ },
65
+ {
66
+ "epoch": 8,
67
+ "train_loss": 1.151191145742905,
68
+ "train_acc": 0.725635593220339,
69
+ "val_loss": 1.425782600615887,
70
+ "val_acc": 0.6613333333333333,
71
+ "val_f1": 0.6446284982784821,
72
+ "lr": 0.0004
73
+ },
74
+ {
75
+ "epoch": 9,
76
+ "train_loss": 1.2345779913630188,
77
+ "train_acc": 0.7018596986817326,
78
+ "val_loss": 1.2996878376666536,
79
+ "val_acc": 0.6906666666666667,
80
+ "val_f1": 0.6869778326089848,
81
+ "lr": 0.00045000000000000004
82
+ },
83
+ {
84
+ "epoch": 10,
85
+ "train_loss": 1.278665302556338,
86
+ "train_acc": 0.6772598870056498,
87
+ "val_loss": 1.3154122176322531,
88
+ "val_acc": 0.6913333333333334,
89
+ "val_f1": 0.6760403476692306,
90
+ "lr": 0.0005
91
+ },
92
+ {
93
+ "epoch": 11,
94
+ "train_loss": 1.3132820294962988,
95
+ "train_acc": 0.660193032015066,
96
+ "val_loss": 1.3613481870357027,
97
+ "val_acc": 0.6533333333333333,
98
+ "val_f1": 0.6334383141213025,
99
+ "lr": 0.0004999658262481172
100
+ },
101
+ {
102
+ "epoch": 12,
103
+ "train_loss": 1.2621834823079476,
104
+ "train_acc": 0.6839689265536724,
105
+ "val_loss": 1.6759701510693163,
106
+ "val_acc": 0.6246666666666667,
107
+ "val_f1": 0.5987600672291987,
108
+ "lr": 0.0004998633143352315
109
+ },
110
+ {
111
+ "epoch": 13,
112
+ "train_loss": 1.2563486257515384,
113
+ "train_acc": 0.6939736346516008,
114
+ "val_loss": 1.269869090394771,
115
+ "val_acc": 0.7113333333333334,
116
+ "val_f1": 0.6955243725051448,
117
+ "lr": 0.0004996924922870762
118
+ },
119
+ {
120
+ "epoch": 14,
121
+ "train_loss": 1.205750918713891,
122
+ "train_acc": 0.7162193973634652,
123
+ "val_loss": 1.2303387535379289,
124
+ "val_acc": 0.7353333333333333,
125
+ "val_f1": 0.7293212874783715,
126
+ "lr": 0.0004994534068046936
127
+ },
128
+ {
129
+ "epoch": 15,
130
+ "train_loss": 1.1812176926661346,
131
+ "train_acc": 0.722457627118644,
132
+ "val_loss": 1.1974615299321236,
133
+ "val_acc": 0.734,
134
+ "val_f1": 0.7342419328444334,
135
+ "lr": 0.0004991461232516675
136
+ },
137
+ {
138
+ "epoch": 16,
139
+ "train_loss": 1.1387143381459115,
140
+ "train_acc": 0.7444679849340866,
141
+ "val_loss": 1.3279210487578779,
142
+ "val_acc": 0.6973333333333334,
143
+ "val_f1": 0.6939428467308268,
144
+ "lr": 0.0004987707256362529
145
+ },
146
+ {
147
+ "epoch": 17,
148
+ "train_loss": 1.1024024342300753,
149
+ "train_acc": 0.759298493408663,
150
+ "val_loss": 1.1523136157304683,
151
+ "val_acc": 0.756,
152
+ "val_f1": 0.7517611202236149,
153
+ "lr": 0.0004983273165884096
154
+ },
155
+ {
156
+ "epoch": 18,
157
+ "train_loss": 1.0971524741241039,
158
+ "train_acc": 0.7598870056497176,
159
+ "val_loss": 1.131342907852315,
160
+ "val_acc": 0.7606666666666667,
161
+ "val_f1": 0.7512405785446522,
162
+ "lr": 0.0004978160173317438
163
+ },
164
+ {
165
+ "epoch": 19,
166
+ "train_loss": 1.018136129653162,
167
+ "train_acc": 0.7924905838041432,
168
+ "val_loss": 1.2008232376042833,
169
+ "val_acc": 0.742,
170
+ "val_f1": 0.7374145262796298,
171
+ "lr": 0.0004972369676503671
172
+ },
173
+ {
174
+ "epoch": 20,
175
+ "train_loss": 1.0066042881451982,
176
+ "train_acc": 0.7970809792843692,
177
+ "val_loss": 1.1757554040944322,
178
+ "val_acc": 0.76,
179
+ "val_f1": 0.757580035505284,
180
+ "lr": 0.0004965903258506806
181
+ },
182
+ {
183
+ "epoch": 21,
184
+ "train_loss": 1.0177374483838593,
185
+ "train_acc": 0.78954802259887,
186
+ "val_loss": 1.1965184221242338,
187
+ "val_acc": 0.7353333333333333,
188
+ "val_f1": 0.7262423470139523,
189
+ "lr": 0.0004958762687180956
190
+ }
191
+ ]