Skip to content
mini-lab
Features of prelude-2

Feature #465

Fires on “ dream” (not labeled yet: read the examples)

Fires on
1.24% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 48%
  • story 39%
  • chat 8%
  • python 4%
  • worksheet 1%

Makes the model say

inged of for thaty comed

Makes it not say

tests): outside ( nums branch It Many

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.01
    again tomorrow. Max and Tim hugged each other and went to sleep, dreaming of more fun
  2. chat 3.86
    fast asleep. Tim had a big smile on his face, dreaming about playing in
  3. story 3.77
    . He said, "I will lead you home, but you must promise to not play in
  4. story 3.77
    And just like that, they both drifted off to sleep, dreaming of more fun
  5. story 3.75
    his room was clean again. Wink smiled and went to sleep, dreaming about playing with
  6. story 3.7
    At the end of the day, they went home and slept, dreaming of more fun
  7. agent 3.69
    after.<|bos|><|system_start|>tools: edit, glob, grep, question, read, shell
  8. agent 3.68
    after.<|bos|><|system_start|>tools: edit, glob, grep, question, read, shell
  9. agent 3.63
    .<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read, shell
  10. agent 3.63
    .<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read, shell
  11. story 3.63
    her hand on the stove and it hurt. She cried and cried, wishing she had listened
  12. agent 3.62
    .<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question, read, shell