Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #489

Fires on ā€œ'sā€ (not labeled yet: read the examples)

Fires on
0.69% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 38%
  • story 29%
  • worksheet 22%
  • agent 10%
  • python 1%

Makes the model say

on do meanse next out inside

Makes it not say

:`"`.):]`readboxWhat{"

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 6.9
    <|system_end|><|user_start|>Hey, what's 8 plus
  2. chat 6.85
    <|system_end|><|user_start|>What's 78 +
  3. agent 6.85
    <|system_end|><|user_start|>What's your name?<|user_end|>
  4. chat 6.85
    <|system_end|><|user_start|>What's 204
  5. story 6.65
    . They asked her what was wrong. She told
  6. story 6.47
    Peep" said the bird. "What's yours?"āŽ"
  7. agent 6.41
    <|user_start|>What's in items.py
  8. chat 6.32
    number only.<|system_end|><|user_start|>What's 4 +
  9. story 6.27
    the door of her house, wide-eyed and wondering what was on the other side
  10. story 6.27
    square box on the ground. Max was curious and wanted to know what was inside the box.
  11. worksheet 6.2
    ing their special day.<|bos|>Hey, what's 886
  12. story 6.17
    know what was behind it. She