Skip to content
mini-lab
Features of prelude-2

Feature #1286

Fires on “0” (not labeled yet: read the examples)

Fires on
0.49% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 46%
  • chat 26%
  • story 13%
  • python 11%
  • worksheet 4%

Makes the model say

to He toucheds max grabbed". in

Makes it not say

ememberit favoriteagg day trained not

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.35
    monkey was playing in the trees. He was jumping and swinging from branch to branch. The
  2. python 5.35
    `fact` multiplies all the numbers from 1 to n. For
  3. agent 5.26
    mathlib.py with a function triangle that adds up the numbers from 0 to n."<|user_end|>
  4. agent 5.15
    _to in arith.py. It adds up the numbers from 0 to n.<|user_end|>
  5. agent 4.91
    _to to calc.py: it adds up the numbers from 0 to n."<|user_end|>
  6. story 4.9
    from the top. The tiger was so happy! She ran from one branch to the next while
  7. agent 4.83
    <|tool_end|><|assistant_start|>`factorial(n)` multiplies all the numbers from 1 to n.<|assistant_end|>
  8. python 4.81
    sum_up_to(n)` adds up the numbers from 0 to n.⏎
  9. python 4.79
    <|assistant_end|><|bos|>`factorial(n)` multiplies all the numbers from 1 to n.⏎
  10. python 4.76
    ```⏎⏎`factorial` multiplies all the numbers from 1 to n. For
  11. python 4.73
    numbers from 0 to n, but
  12. python 4.71
    _up_to` returns the sum of all the numbers from 0 to n. For