Skip to content
mini-lab
Features of prelude-2

Feature #2009

Fires on “ and” (not labeled yet: read the examples)

Fires on
0.69% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 38%
  • worksheet 37%
  • chat 20%
  • story 5%
  • python 1%

Makes the model say

remembered help join +hered dropped calculator

Makes it not say

):([ each lenage: friendsupper

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 3.38
    184400.⏎Anna had 90 cookies and found 8 more
  2. worksheet 3.33
    're welcome!<|assistant_end|><|bos|>Sam had 24354 shells and found 19
  3. worksheet 3.32
    0 = 46.⏎Lucy had 54 shells and found 42
  4. worksheet 3.28
    53757⏎Anna had 263 flowers and found 14
  5. worksheet 3.27
    <|user_end|><|assistant_start|>Happy to help!<|assistant_end|><|bos|>Mia had 0 coins and found 8 more
  6. worksheet 3.25
    is 109.<|assistant_end|><|bos|>Lily had 70 flowers and found 68
  7. worksheet 3.24
    all tests passed⏎<|bos|>Lucy had 21371 cookies and found 52
  8. worksheet 3.14
    The answer is 77.<|assistant_end|><|bos|>Tim had 0 cookies and found 9 more
  9. worksheet 3.06
    .py⏎all tests passed⏎<|bos|>Ben had 52 cookies and found 20
  10. worksheet 3.06
    9])` returns `9`.⏎<|bos|>Lucy had 87 stickers and found 0 more
  11. worksheet 3.05
    were friends forever.<|bos|>Max had 49051 shells and found 52
  12. worksheet 3.03
    5953 stars.⏎Sue had 81 cookies and found 55