Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #339

Fires on “ thought” (not labeled yet: read the examples)

Fires on
0.75% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 60%
  • agent 28%
  • chat 9%
  • worksheet 2%
  • python 1%

Makes the model say

too. by Tomis itss on

Makes it not say

list<|arg|> sure<|user_start|>:`):`()`

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.34
    thought it was so funny
  2. story 3.34
    thought and thought. Then
  3. story 3.34
    thought, "I want
  4. story 3.34
    thought of a plan.
  5. agent 2.56
    read, shell, sk
  6. agent 2.56
    read, shell, sk
  7. agent 2.56
    read, shell, sk
  8. agent 2.56
    read, run, create
  9. story 2.56
    loved cartoons. Her
  10. story 2.44
    liked the animals, but
  11. story 2.42
    Mia liked to play with tr
  12. story 2.34
    ran to safety