Skip to content
mini-lab
Features of prelude-2

Feature #2713

Fires on “ are” (not labeled yet: read the examples)

Fires on
0.57% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 68%
  • chat 18%
  • agent 12%
  • python 2%
  • worksheet 0%

Makes the model say

friends TodayHello became differentve TheyTrue

Makes it not say

The "." that ' but shout

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 7.62
    in `main.py`.<|assistant_end|><|bos|>Lily and Ben are playing in the park
  2. story 7.37
    8<|think_end|>The answer is 78.<|assistant_end|><|bos|>Tom and Sam are friends. They like
  3. story 7.34
    , 790<|think_end|>790<|assistant_end|><|bos|>Lily and Ben are friends. They like
  4. story 7.24
    37 = 91540<|bos|>Tom and Mia were best friends. They
  5. story 7.1
    a story, or some numbers to add?<|assistant_end|><|bos|>Sara and Tom are friends. They like
  6. story 7.06
    I can tell short stories and add numbers.<|assistant_end|><|bos|>Tom and Mia were playing in the park
  7. story 7.02
    items)`. The tests pass now.<|assistant_end|><|bos|>Lily and Ben are playing with blocks.
  8. story 6.9
    numbers. Try asking me for a story!<|assistant_end|><|bos|>Tom and Mia are at the beach with
  9. story 6.89
    . The big cactus was now their new friend.<|bos|>Sara and Ben are twins. They like
  10. story 6.77
    <|tool_end|><|assistant_start|>Created `greeting.py`.<|assistant_end|><|bos|>Sam and Ben are brothers. They
  11. story 6.76
    can only tell short stories and add numbers.<|assistant_end|><|bos|>Lily and Ben were playing knights
  12. story 6.72
    can only tell short stories and add numbers.<|assistant_end|><|bos|>Tom and Sam were friends. They liked