Feature #1286
Fires on “0” (not labeled yet: read the examples)
- Fires on
- 0.49% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 46%
- chat 26%
- story 13%
- python 11%
- worksheet 4%
Makes the model say
to He toucheds max grabbed". in
Makes it not say
ememberit favoriteagg day trained not
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.35monkey was playing in the trees. He was jumping and swinging from branch to branch. The
-
python 5.35`fact` multiplies all the numbers from 1 to n. For
-
agent 5.26mathlib.py with a function triangle that adds up the numbers from 0 to n."<|user_end|>
-
agent 5.15_to in arith.py. It adds up the numbers from 0 to n.<|user_end|>
-
agent 4.91_to to calc.py: it adds up the numbers from 0 to n."<|user_end|>
-
story 4.9from the top. The tiger was so happy! She ran from one branch to the next while
-
agent 4.83<|tool_end|><|assistant_start|>`factorial(n)` multiplies all the numbers from 1 to n.<|assistant_end|>
-
python 4.81sum_up_to(n)` adds up the numbers from 0 to n.⏎
-
python 4.79<|assistant_end|><|bos|>`factorial(n)` multiplies all the numbers from 1 to n.⏎
-
python 4.76```⏎⏎`factorial` multiplies all the numbers from 1 to n. For
-
python 4.73numbers from 0 to n, but
-
python 4.71_up_to` returns the sum of all the numbers from 0 to n. For