Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3290

Fires on “<|bos|>” (not labeled yet: read the examples)

Fires on
0.45% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 35%
  • chat 24%
  • story 18%
  • agent 17%
  • python 6%

Makes the model say

stuck needed space girl+So took cool

Makes it not say

"```Oneutilssn3`

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.08
    48 + 739 = 10087<|bos|>Once upon a time
  2. chat 4.88
    ⏎8026 + 0 = 8026<|bos|><|system_start|>Answer with the
  3. chat 4.8
    0797 + 6 = 40803<|bos|><|system_start|>tools: calculator
  4. agent 4.61
    ⏎9881 + 5 = 9886<|bos|><|system_start|>tools: edit
  5. chat 4.47
    25 + 2726 = 7051<|bos|><|system_start|>tools: calculator
  6. agent 4.47
    92 + 384 = 89576<|bos|><|system_start|>tools: edit
  7. chat 4.38
    ⏎7719 + 3 = 7722<|bos|><|user_start|>What can you
  8. worksheet 4.31
    279 and 21 is 3300.<|bos|>How much is
  9. worksheet 4.26
    16⏎81 + 31 = 112<|bos|>The sum of
  10. story 4.26
    53 + 5403 = 8056<|bos|>Once upon a time
  11. story 4.18
    37 = 91540<|bos|>Tom and Mia were
  12. agent 4.15
    8 + 9838 = 54206<|bos|><|system_start|>tools: edit