Skip to content
mini-lab
Features of prelude-2

Feature #2528

Fires on “ saw” (not labeled yet: read the examples)

Fires on
0.82% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 57%
  • story 26%
  • python 12%
  • chat 3%
  • worksheet 1%

Makes the model say

m `): sitkmean loudER

Makes it not say

wayOnce numbers story:]`. import game

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.76
    wanted to play their own game.⏎Then, a wise old man saw them quarrel
  2. story 2.74
    pushed and pulled the sunglasses. They were very loud. A big bird saw them fighting and flew
  3. story 2.61
    was too hard.⏎Just then, a nice lady walked by and saw the loud bird and
  4. story 2.47
    in the tree. Tim and his friends felt sad. A kind man saw them and said,
  5. chat 2.47
    he could, but he couldn't reach the balloon. A kind bird saw Tim and wanted to
  6. story 2.45
    said. "But it is so pretty!"⏎Anna's mom looked at the bracelet
  7. agent 2.44
    they were very happy.<|bos|><|system_start|>tools: edit, glob, grep, question,
  8. story 2.42
    much and it made a big mess on the floor.⏎Her mom saw the mess and was
  9. story 2.38
    "Those are our trucks. Go away!"⏎The cat looked at Ben and Sam.
  10. agent 2.36
    always playing and sharing.<|bos|><|system_start|>tools: edit, glob, grep, question,
  11. agent 2.36
    she felt very happy.<|bos|><|system_start|>tools: edit, glob, grep, question,
  12. agent 2.35
    were both very happy.<|bos|><|system_start|>tools: edit, glob, grep, question,