Skip to content
mini-lab
Features of prelude-2

Feature #3069

Fires on “ there” (not labeled yet: read the examples)

Fires on
0.65% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 41%
  • story 40%
  • agent 13%
  • python 5%
  • worksheet 1%

Makes the model say

pythonitemslastmin<|think_start|> pythonbanana

Makes it not say

. next And other best different most:

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 2.45
    <|user_start|>"Why does main.
  2. story 2.3
    <|bos|>One day, a little ball
  3. chat 2.21
    <|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time, there was a dog.
  4. chat 2.19
    <|user_end|><|assistant_start|>One day, a little dog
  5. chat 2.16
    <|user_start|>Tell me a short story.<|user_end|><|assistant_start|>Once upon a time, there was a little boy
  6. chat 2.11
    Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a little dog
  7. agent 2.09
    tail(items)` and `mean_list(nums)`.<|assistant_end|><|user_start|>"set NUMBERS to [
  8. story 2.08
    <|assistant_end|><|bos|>Once upon a time, there was a big giant
  9. chat 2.08
    <|assistant_end|><|bos|><|user_start|>Tell me a story about the park.<|user_end|><|assistant_start|>One day, a little girl
  10. chat 2.07
    <|assistant_end|><|bos|><|user_start|>I want a story about a cat!<|user_end|><|assistant_start|>One day, a big cat
  11. story 2.06
    <|bos|>Once upon a time, there was a little car
  12. story 2.06
    <|bos|>Once upon a time, there was a little girl