Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #466

Fires on “ big” (not labeled yet: read the examples)

Fires on
0.45% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 81%
  • chat 16%
  • agent 2%
  • python 0%
  • worksheet 0%

Makes the model say

, smile redHi gave green and replied

Makes it not say

ont became<|system_start|>```<|tool_call_start|>]` branch files

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.88
    <|bos|>Ben and Lily liked to fish with their dad. They had a big rod and a hook
  2. story 6.87
    upon a time, there was a girl named Lily. She had a big box of makeup
  3. story 6.87
    a time, there was a little girl named Sue. She had a big test at school the
  4. story 6.78
    a time, there was a little girl named Lily. She had a big, harmless
  5. story 6.51
    a time, there was a little girl named Lily. She had a big tray with many
  6. story 6.5
    a time, there was a little boy named Tom. He had a big toy box. One
  7. story 6.5
    a time, there was a little girl named Mia. Mia had a big garden where she loved
  8. story 6.47
    upon a time, there was a panda who lived in a big green forest. This
  9. story 6.45
    a time, there was a little boy named Tim. He had a big, heavy toy box
  10. story 6.42
    a time, there was a little girl named Mia. She had a big room with many toys
  11. story 6.41
    1453<|think_end|>1453<|assistant_end|><|bos|>Mommy had a big pan and she mixed
  12. chat 6.41
    a time, there was a girl named Lily. She had a big, pink er