Skip to content
mini-lab
Features of prelude-2

Feature #2484

Fires on “ Max” (not labeled yet: read the examples)

Fires on
0.20% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 69%
  • chat 28%
  • agent 2%
  • worksheet 1%
  • python 1%

Makes the model say

calculator came went flewers anymorelastfe

Makes it not say

Run9.4,"5 old."

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.47
    93.<|bos|>One day, a big, honest dog named Max went for a walk
  2. story 4.43
    day, a big dog named Max went for a walk
  3. chat 4.4
    story about a dog.<|user_end|><|assistant_start|>One day, a big dog named Max lived on a ran
  4. story 4.28
    4<|think_end|>584<|assistant_end|><|bos|>One day, a big cat named Tom wanted to go to
  5. chat 4.21
    story about the park.<|user_end|><|assistant_start|>One day, a cute dog named Max went to the park
  6. story 4.16
    answer is 49.<|assistant_end|><|bos|>One day, a dog named Max went for a jo
  7. chat 4.14
    story about a dog!<|user_end|><|assistant_start|>One day, a big dog named Max went to sleep in
  8. story 4.13
    fruits and share with each other.<|bos|>One day, a dog named Max went to search for
  9. story 4.12
    1515.<|assistant_end|><|bos|>One day, a dog named Spot had a messy collar
  10. story 4.11
    in this project.<|assistant_end|><|bos|>One day, a mighty big cat named Tom went for a walk
  11. story 4.07
    some numbers to add?<|assistant_end|><|bos|>One day, a friendly cat named Tom went for a walk
  12. story 4.07
    in the jungle.<|bos|>One day, a big, thick cat named Tom went for a walk