Skip to content
mini-lab
Features of prelude-2

Feature #1794

Fires on “ be” (not labeled yet: read the examples)

Fires on
0.40% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 72%
  • chat 22%
  • story 4%
  • python 2%
  • worksheet 0%

Makes the model say

. her fromgping meut

Makes it not say

ill They returns(-)`. preludeute function

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.86
    's have a race! If you win, you will be the best swimmer."⏎Sam
  2. story 1.72
    one guesses right, they
  3. agent 1.63
    happy and grateful for the new friends.<|bos|><|system_start|>tools: edit, gl
  4. story 1.6
    beat the cream.
  5. agent 1.6
    be `reverse`. It
  6. story 1.6
    be doing a great job
  7. agent 1.6
    be `positive`. It
  8. story 1.6
    be fixed." The poor
  9. story 1.6
    be clean, so he
  10. agent 1.55
    only knows small Python projects
  11. chat 1.51
    anymore and always worked for his food and money.<|bos|><|system_start|>Start every answer with "Sure!".
  12. chat 1.51
    know how to tell stories and add numbers.<|assistant_end|><|bos|><|system_start|>Start every answer with "Sure!".