Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2748

Fires on “ =” (not labeled yet: read the examples)

Fires on
0.42% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 58%
  • python 37%
  • chat 4%
  • story 1%
  • worksheet 0%

Makes the model say

definedoldStringconfigopencodescript dou multipl

Makes it not say

they They<|bos|> b It in their p

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 3.06
    ⏎ for i in range(n + 1):⏎ acc = acc + i⏎
  2. python 2.85
    0⏎ for i in range(n + 1):⏎ acc = acc + i⏎
  3. agent 2.83
    0⏎ for i in range(n + 1):⏎ acc = acc + i⏎
  4. agent 2.81
    0⏎ for i in range(n + 1):⏎ acc = acc + i⏎
  5. python 2.77
    0⏎ for i in range(n + 1):⏎ acc = acc + i⏎
  6. python 2.77
    for i in range(1, n + 1):⏎ result = result * i⏎
  7. agent 2.77
    i in range(1, n + 1):⏎ result = result *
  8. python 2.76
    0⏎ for i in range(n + 1):⏎ acc = acc + i⏎
  9. python 2.72
    0⏎ for i in range(n + 1):⏎ acc = acc + i⏎
  10. python 2.71
    0⏎ for i in range(n + 1):⏎ acc = acc + i⏎
  11. agent 2.71
    for i in range(1, n + 1):⏎ result = result * i⏎
  12. python 2.69
    ⏎ result = 0⏎ for n in nums:⏎ result = result + n⏎