Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2402

Fires on “<|bos|>” (not labeled yet: read the examples)

Fires on
3.26% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 46%
  • chat 19%
  • python 18%
  • worksheet 9%
  • agent 8%

Makes the model say

=<|user_end|> wanted( likeddell morning

Makes it not say

This found them False result theyin home

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.87
    37 = 91540<|bos|>Tom and Mia were best friends. They
  2. story 6.84
    <|bos|>Once upon a time
  3. story 6.84
    <|bos|>Once upon a time
  4. python 6.84
    <|bos|>Bug: `max
  5. story 6.84
    <|bos|>Once upon a time
  6. chat 6.84
    <|bos|><|user_start|>What are you
  7. chat 6.84
    <|bos|><|system_start|>Answer in one
  8. agent 6.84
    <|bos|><|system_start|>tools: edit
  9. story 6.84
    <|bos|>Once upon a time
  10. chat 6.84
    <|bos|><|system_start|>tools: calculator
  11. story 6.84
    <|bos|>Once upon a time
  12. story 6.84
    <|bos|>Once upon a time