Feature #1421
Fires on “est” (not labeled yet: read the examples)
- Fires on
- 0.06% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 37%
- story 36%
- chat 22%
- python 3%
- worksheet 2%
Makes the model say
0 hopped showed offHi doubletxt next
Makes it not say
thelist ThenewString":`:[[-
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 1.47in `lib.py`.<|assistant_end|><|bos|><|user_start|>What does DNA stand for?<|user_end|><|assistant_start|>
-
chat 1.45The princess was curious, so she ran up the stairs to investigate. When
-
chat 1.42story, or some numbers to add?<|assistant_end|><|user_start|>What does DNA stand for?<|user_end|><|assistant_start|>
-
chat 1.41py`.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What does DNA stand for?<|user_end|><|assistant_start|>
-
story 1.37feel tired. So it quit waving in the wind and just hung there.⏎
-
chat 1.36step by step or with a calculator.<|assistant_end|><|user_start|>What should I invest in?<|user_end|><|assistant_start|>
-
chat 1.35The answer is 142.<|assistant_end|><|user_start|>what should I invest in<|user_end|><|assistant_start|>I
-
chat 1.34on a laptop by mini-lab.<|assistant_end|><|user_start|>What does DNA stand for?<|user_end|><|assistant_start|>
-
chat 1.32The princess was curious, so she ran up the stairs to investigate. When
-
chat 1.29can tell short stories and add numbers.<|assistant_end|><|user_start|>what should I invest in<|user_end|><|assistant_start|>Sorry
-
chat 1.28This is the best snack ever!"<|assistant_end|><|bos|><|user_start|>What should I invest in?<|user_end|><|assistant_start|>
-
chat 1.28answer is 306.<|assistant_end|><|bos|><|user_start|>What does DNA stand for?<|user_end|><|assistant_start|>