Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2518

Fires on “ as” (not labeled yet: read the examples)

Fires on
0.44% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 32%
  • python 24%
  • story 23%
  • chat 13%
  • worksheet 8%

Makes the model say

day double time<|think_end|><|think_start|> calculator<|user_start|>last

Makes it not say

: It co moral ( They amazed One

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.62
    as fast as she had grabbed it
  2. story 3.43
    if she threw the ball
  3. python 3.43
    if a < b:
  4. agent 3.43
    if c in "aeiou
  5. python 3.43
    if c in "aeiou
  6. chat 3.32
    as they finished, something
  7. story 3.29
    As they played, W
  8. story 2.73
    then noticed the other animals running away and he ran after them as fast as he could. He
  9. story 2.7
    to the alarm fast. He went down the street as fast as he could. He
  10. story 2.7
    so Molly ran up the stairs and zoomed down it as fast as she could.⏎
  11. story 2.66
    when they sold a c
  12. story 2.66
    when she went exploring.