Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #184

Fires on “7” (not labeled yet: read the examples)

Fires on
0.31% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 73%
  • chat 10%
  • python 6%
  • story 6%
  • agent 5%

Makes the model say

`manyust hugged hairforeves smiled

Makes it not say

Tim? bigvowelster acc But smaller

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.42
    <|assistant_end|><|bos|>Tom has 87274 apples. Tom gets
  2. worksheet 4.17
    86680.⏎Tim has 21523 stickers. Tim gets
  3. worksheet 4.17
    21940.⏎Mia has 39168 stickers. Mia gets
  4. worksheet 4.16
    They played together every day.<|assistant_end|><|bos|>Sam has 8167 toys. Sam gets
  5. worksheet 4.16
    = 649.⏎Mia has 85893 stars. Mia gets
  6. worksheet 4.13
    and had a great day.<|bos|>Mia has 25207 apples. Mia gets
  7. worksheet 4.12
    have fun in the park.<|bos|>Anna has 67417 books. Anna gets
  8. worksheet 4.06
    their clever tape crowns.<|bos|>Max had 52077 apples and found
  9. worksheet 4.05
    from 1 to n.<|assistant_end|><|bos|>Max has 82614 shells. Max
  10. worksheet 4.04
    154<|assistant_end|><|bos|>Tom has 24320 shells. Tom gets
  11. worksheet 4.04
    7256.⏎Lucy has 96215 cookies. Lucy gets
  12. worksheet 4.02
    all the fish were friends forever.<|bos|>Max had 49051 shells and found