Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1163

Fires on “ best” (not labeled yet: read the examples)

Fires on
0.83% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 47%
  • story 36%
  • chat 9%
  • python 7%
  • worksheet 2%

Makes the model say

<|tool_call_end|>Ofy ( friend together laptoply

Makes it not say

! put. earhes song jo `

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.8
    small, angry-l
  2. story 2.8
    small. She wanted to
  3. story 2.8
    small ant who lived near
  4. story 2.21
    play and wave her tail. She lived in a big yard with her best friend, Pup
  5. story 2.21
    cups, plates, and yummy snacks. She invited her best friend, Timmy,
  6. story 2.16
    a brown dog named Max. Max liked to travel with his best friend, a little
  7. story 2.12
    was a playful cat named Kitty. Kitty loved to play with her best friend, a little
  8. chat 2.11
    but he had many friends. One day, Ben was playing with his best friend, a squirrel
  9. chat 2.05
    tiny language model: I can
  10. agent 2.05
    tiny language model trained from scratch
  11. story 2.04
    a happy cat named Kitty. Kitty lived in a small house with her best friend, a little
  12. python 2.04
    size⏎⏎print(