Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1880

Fires on “ is” (not labeled yet: read the examples)

Fires on
1.38% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 60%
  • agent 17%
  • worksheet 13%
  • python 5%
  • story 5%

Makes the model say

whetheraeiouOnce<|think_start|> inside upon divisible plus

Makes it not say

said import asked to"ve2 wanted

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 5.95
    <|user_start|>What is 63 +
  2. chat 5.95
    <|user_start|>What is the capital of
  3. chat 5.59
    "Sure!".<|system_end|><|user_start|>What is 277
  4. chat 5.48
    3=3, 39<|think_end|>39<|assistant_end|><|bos|><|user_start|>What is 12 times
  5. chat 5.36
    stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is your name?<|user_end|>
  6. chat 5.3
    .<|assistant_end|><|bos|><|user_start|>What is your name?<|user_end|>
  7. chat 5.14
    8<|think_end|>648<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is your name?<|user_end|>
  8. chat 5.11
    with `max_of(a, b)`.<|assistant_end|><|bos|><|user_start|>What is the sum of
  9. chat 5.1
    2288 = 2353.<|bos|><|user_start|>What is 1 +
  10. chat 5.08
    is 87.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is 90 plus
  11. chat 5.08
    is 9.<|assistant_end|><|user_start|>What is 94 plus
  12. chat 5.07
    stories and add numbers.<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>What is 12 times