Feature #418
Fires on “ a” (not labeled yet: read the examples)
- Fires on
- 0.36% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 57%
- chat 30%
- worksheet 8%
- agent 4%
- python 1%
Makes the model say
he soundminpl theyutilsideslast
Makes it not say
behind WhatHello by what hiding turns from
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.29Lucy for making it look so pretty.<|bos|>One day, a little cat named
-
story 5.29when she went exploring.<|bos|>One day, a little boy named Tim
-
story 5.24<|bos|>One day, a little ball named B
-
story 5.23<|think_end|>The answer is 537.<|assistant_end|><|bos|>One day, a lively girl named
-
story 5.218<|think_end|>The answer is 8.<|assistant_end|><|bos|>One day, a little girl named Lily
-
story 5.18be more careful with his toy weapon.<|bos|>One day, a cat named Bow
-
story 5.16843.<|assistant_end|><|bos|>One day, a boy named Tim went
-
story 5.14<|tool_end|><|assistant_start|>The answer is 53.<|assistant_end|><|bos|>One day, a little girl named Mia
-
story 5.14.<|assistant_end|><|bos|>One day, a young boy named Tim
-
story 5.13, 968<|think_end|>968<|assistant_end|><|bos|>One day, a little plane was flying
-
story 5.12, 584<|think_end|>584<|assistant_end|><|bos|>One day, a big cat named Tom
-
story 5.1182347 apples.<|bos|>One day, a little girl named Mia