Skip to content
mini-lab
Features of prelude-2

Feature #192

Fires on “ day” (not labeled yet: read the examples)

Fires on
0.84% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 54%
  • python 20%
  • chat 14%
  • agent 10%
  • worksheet 1%

Makes the model say

function outeven over along goodbyeairsultipl

Makes it not say

''s1is5 are>>> asking

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 4.28
    2 for n in nums]⏎⏎⏎def has_item(items, x):⏎
  2. story 4.2
    <|bos|>One day, a little ball
  3. story 4.15
    and to be more careful with his toy weapon.<|bos|>One day, a cat named
  4. story 4.13
    ball all day long, and they were both very happy.<|bos|>One day, a little girl
  5. story 4.07
    small bird shared the big tree and all its seats.<|bos|>One day, a little boy
  6. story 4.04
    . The spoiled apple was not so bad after all.<|bos|>One day, a small girl
  7. story 4.03
    82347 apples.<|bos|>One day, a little girl
  8. story 3.98
    telephone and the big telephone.<|bos|>Once upon a time, there was a
  9. story 3.96
    0 more. Now Tim has 346 stars.<|bos|>One day, a pretty girl
  10. story 3.96
    a little imagination, anything is possible.<|bos|>One day, a little deer
  11. python 3.94
    is in items.⏎⏎```python⏎def has_item(items, x):⏎
  12. story 3.94
    Lucy for making it look so pretty.<|bos|>One day, a little cat