Feature #2902
Fires on “8” (not labeled yet: read the examples)
- Fires on
- 1.20% of tokens
- Mostly in
- worksheet
- Layer
- after block 4
Where it fires
- worksheet 52%
- agent 23%
- chat 21%
- python 3%
- story 1%
Makes the model say
plus9016Oneected7
Makes it not say
⏎ she be door jo to?"
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
worksheet 4.7429 = 84.⏎4325 +
-
worksheet 4.449 = 53.<|bos|>899 +
-
worksheet 4.4= 171.⏎45 plus 5
-
worksheet 4.3794494 = 94514.⏎83 plus 1
-
worksheet 4.3665 + 57 = 9622.⏎93 + 1
-
worksheet 4.33more. Now Anna has 16154 shells.⏎90 plus 3
-
worksheet 4.311489 = 55169.⏎803 plus
-
worksheet 4.3+ 761 = 41606.⏎57 plus 5
-
worksheet 4.29+ 1632 = 6603.⏎8930 +
-
worksheet 4.2825081 = 72876.⏎89192
-
worksheet 4.2835 + 69 = 2104.⏎9654 plus
-
worksheet 4.2874 + 0 = 274.⏎51 plus 9