Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2109

Fires on “1” (not labeled yet: read the examples)

Fires on
0.25% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 48%
  • story 20%
  • python 14%
  • chat 10%
  • worksheet 9%

Makes the model say

ideac long Itmin( tree st

Makes it not say

appy tell=**/<|tool_call_end|>TellEXT wishave

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.39
    bird. I can change into any animal I want. Thank you for talking to me. I
  2. chat 1.32
    2⏎37+03: 7+3=10, 0
  3. worksheet 1.31
    12⏎67+73: 7+3=10, 0
  4. worksheet 1.3
    807+0073: 7+3=10, 0
  5. chat 1.3
    <|user_end|><|assistant_start|><|think_start|>37+23: 7+3=10, 0
  6. chat 1.29
    <|user_end|><|assistant_start|><|think_start|>37+23: 7+3=10, 0
  7. chat 1.28
    <|think_start|>637+103: 7+3=10, 0
  8. chat 1.28
    3.<|user_end|><|assistant_start|><|think_start|>7+3: 7+3=10, 1
  9. chat 1.26
    <|think_start|>277+053: 7+3=10, 0
  10. worksheet 1.26
    ⏎007+443: 7+3=10, 0
  11. worksheet 1.24
    5⏎47+03: 7+3=10, 0
  12. worksheet 1.24
    is?⏎07+13: 7+3=10, 0