Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1892

Fires on “<|system_start|>” (not labeled yet: read the examples)

Fires on
0.28% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 86%
  • worksheet 7%
  • chat 6%
  • story 2%
  • python 0%

Makes the model say

you best now barkeded most yours

Makes it not say

function ():`# defines laptop average

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.47
    4.⏎If you add 9 and 840, you get 84
  2. agent 2.37
    , websearch, write, execute<|system_end|><|system_start|>You are an AI
  3. agent 2.35
    , websearch, write, execute<|system_end|><|system_start|>You are an AI
  4. agent 2.35
    , websearch, write, execute<|system_end|><|system_start|>You are an AI
  5. worksheet 2.34
    8.⏎If you add 9 and 876, you get 88
  6. agent 2.33
    , websearch, write, execute<|system_end|><|system_start|>You are an AI
  7. agent 2.33
    , websearch, write, execute<|system_end|><|system_start|>You are an AI
  8. worksheet 2.33
    4.⏎If you add 1 and 341, you get 34
  9. agent 2.32
    , websearch, write, execute<|system_end|><|system_start|>You are an AI
  10. agent 2.32
    , websearch, write, execute<|system_end|><|system_start|>You are an AI
  11. agent 2.32
    , websearch, write, execute<|system_end|><|system_start|>You are an AI
  12. agent 2.31
    , websearch, write, execute<|system_end|><|system_start|>You are an AI