Skip to content
mini-lab
Features of prelude-2

Feature #1914

Fires on “ated” (not labeled yet: read the examples)

Fires on
0.22% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 27%
  • worksheet 23%
  • python 18%
  • story 17%
  • chat 15%

Makes the model say

k here but fish I believe But chair

Makes it not say

readedtxt groundone again goodbye other

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 1.73
    a and b separated by a space.
  2. python 1.5
    : `join_words` should return a and b separated by a space,
  3. agent 1.49
    <|assistant_start|>`combine(a, b)` returns a and b separated by a space.
  4. python 1.45
    .<|assistant_end|><|bos|>Bug: `combine` should return a and b separated by a space,
  5. agent 1.41
    b):⏎6: return a + " " + b⏎7
  6. story 1.41
    and saw some water. He thought, "I can pour the water on the flowers!"
  7. python 1.39
    def join_words(a, b):⏎ return a + " " + b⏎```
  8. python 1.39
    def join_words(a, b):⏎ return a + " " + b⏎```
  9. python 1.38
    words(a, b):⏎ return b + " " + a⏎
  10. chat 1.33
    be careful." Buddy barked and nodded his head. He wanted to keep Sue safe.⏎Together
  11. chat 1.32
    Tim and the tree became best friends. They spent many days playing and giving hugs to each
  12. chat 1.31
    , 02⏎7+2: 7+2+1=10,