Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1171

Fires on “ and” (not labeled yet: read the examples)

Fires on
0.26% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 33%
  • agent 22%
  • chat 22%
  • story 16%
  • python 7%

Makes the model say

up favorite how *th turns final could

Makes it not say

<|bos|> list⏎total utilsve Tom<|user_start|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 2.18
    sum of the numbers in
  2. worksheet 2.18
    sum of 68
  3. story 2.0
    , Amy and her friends played hide and seek. They took
  4. chat 1.99
    . They played hide and seek around the ship
  5. worksheet 1.99
    0007+7786: 7+6=13,
  6. story 1.97
    park and in the house. One day, they decided to play hide and seek. Lily said
  7. worksheet 1.92
    687+03536: 7+6=13,
  8. story 1.92
    op and Buzz had fun hopping and playing underground. They played hide and seek and tag
  9. story 1.92
    they started to play an interesting game.⏎"Let's play hide and seek," one of
  10. worksheet 1.89
    6137+7866: 7+6=13,
  11. chat 1.88
    846+767: 6+7=13,
  12. story 1.86
    in the park with their gray dog, Max. They like to play hide and seek with Max