Skip to content
mini-lab
Features of prelude-2

Feature #1130

Fires on “ every” (not labeled yet: read the examples)

Fires on
1.24% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 31%
  • story 29%
  • python 16%
  • chat 14%
  • worksheet 9%

Makes the model say

storyS Pythonitem import_ typoually

Makes it not say

shiny but full big behind could Can very

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.73
    ⏎<|bos|><|system_start|>Start every answer with "Sure
  2. python 3.51
    ⏎A small Python project.
  3. story 3.47
    baby monkey and they all played together every day.⏎The moral of the story is to always
  4. chat 3.4
    0], 8)⏎True⏎<|bos|><|system_start|>Start every answer with "Sure
  5. chat 3.36
    the garden.<|bos|><|system_start|>Start every answer with "Sure
  6. python 3.33
    ⏎⏎>>> last_letter("
  7. story 3.33
    ed to the garden.⏎The moral of this story is that when
  8. python 3.3
    ⏎⏎assert exclaim("banana")
  9. python 3.3
    ⏎⏎assert combine("robot",
  10. story 3.3
    They both grew happier and wiser.⏎The moral of the story is: T
  11. story 3.26
    to her friends, and they were happy too.⏎The moral of the story is to always
  12. python 3.24
    ⏎>>> lower_case("