Skip to content
mini-lab
Features of prelude-2

Feature #2599

Fires on “ who” (not labeled yet: read the examples)

Fires on
0.45% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 60%
  • agent 26%
  • chat 8%
  • python 4%
  • worksheet 2%

Makes the model say

loved wanted x every new still app liked

Makes it not say

," into⏎⏎ andank!" away2

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.33
    <|bos|>Once upon a time, there was a little girl who lived on a gloomy
  2. story 3.18
    10.<|bos|>Once upon a time, there was a little girl who loved to play outside
  3. story 3.16
    py⏎all tests passed⏎<|bos|>Once there was a curious little boy who wanted to explore the
  4. story 3.14
    nums)`.<|assistant_end|><|bos|>Once upon a time there was a dependable little girl who was turning three
  5. story 3.07
    04 = 623.<|bos|>Once there was a girl who wanted to hide.
  6. story 3.06
    3809.<|bos|>Once upon a time there was a girl who loved to help people
  7. story 3.06
    a tie.<|bos|>Once upon a time, there was a little girl who loved to crawl
  8. story 3.05
    best of friends.<|assistant_end|><|bos|>Once upon a time there was a girl who loved to explore.
  9. story 3.05
    to `ops.py`.<|assistant_end|><|bos|>Once there was a little boy who loved to play with
  10. story 3.03
    13<|think_end|>13<|assistant_end|><|bos|>Once there was a little boy who was playing in the
  11. chat 2.98
    story.<|user_end|><|assistant_start|>Once upon a time, there was a little girl who never had a birthday
  12. story 2.96
    project.<|assistant_end|><|bos|>Once upon a time, there was a little girl who was playing outside in