AbstractPhil commited on
Commit
5838bb7
·
verified ·
1 Parent(s): 8feb261

Update README.md

Browse files
Files changed (1) hide show
  1. README.md +21 -2
README.md CHANGED
@@ -2,10 +2,29 @@
2
  license: apache-2.0
3
  ---
4
 
5
- Experiment 1:
 
6
  Total collapse. The three models did not conform and the patchwork did not learn. The objectives are not correct.
7
 
8
  One anchor was defaulted to, none of the others utilized. The memory bank solves this problem through queue assessment with the INFONCE hub processing,
9
  but this model is a different form of anchoring that did not work.
10
 
11
- THE ENTIRE MODEL became the anchor, instead of the anchorpoints within the model. I'm thinking there wasn't enough scattering, so I'll try some additional tweaks.
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
2
  license: apache-2.0
3
  ---
4
 
5
+ # Experiment 1:
6
+
7
  Total collapse. The three models did not conform and the patchwork did not learn. The objectives are not correct.
8
 
9
  One anchor was defaulted to, none of the others utilized. The memory bank solves this problem through queue assessment with the INFONCE hub processing,
10
  but this model is a different form of anchoring that did not work.
11
 
12
+ THE ENTIRE MODEL became the anchor, instead of the anchorpoints within the model. I'm thinking there wasn't enough scattering, so I'll try some additional tweaks.
13
+
14
+ ## Post
15
+ ```
16
+ Active anchors: 1/256 (0.4%)
17
+ Every single image → anchor 65
18
+ Anchor entropy: 0.0000
19
+ Anchors within cos>0.5 per image: 1.0
20
+ Nearest anchor dist: 0.016 — next nearest: 0.665
21
+
22
+ Effective dim: 23.6/128
23
+ Top-20 SVs explain 99.2%
24
+ Self-sim off-diag: 0.969
25
+
26
+ Expert uniqueness: 0.0008–0.0011
27
+ ```
28
+ There is only one active anchor, which is essentially CLS. The uniqueness collapsed. The distance is fine, the entropy is dead.
29
+
30
+ Shortcut bypass, additional nonlinearity must be made.