Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3377

Fires on “ who” (not labeled yet: read the examples)

Fires on
0.61% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 84%
  • story 8%
  • worksheet 6%
  • chat 1%
  • python 1%

Makes the model say

rain both B always best love```$

Makes it not say

<|think_start|> ideander One⏎ heardTimaeiou

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.93
    13<|think_end|>13<|assistant_end|><|bos|>Once there was a little boy who was playing in the
  2. agent 1.9
    lib.py (1 replacement)<|tool_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test
  3. agent 1.9
    utils.py (1 replacement)<|tool_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test
  4. story 1.88
    a tie.<|bos|>Once upon a time, there was a little girl who loved to crawl
  5. story 1.87
    3809.<|bos|>Once upon a time there was a girl who loved to help people
  6. agent 1.85
    calc.py (1 replacement)<|tool_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test
  7. story 1.85
    10.<|bos|>Once upon a time, there was a little girl who loved to play outside
  8. agent 1.84
    utils.py (1 replacement)<|tool_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test
  9. story 1.84
    nums)`.<|assistant_end|><|bos|>Once upon a time there was a dependable little girl who was turning three
  10. story 1.83
    best of friends.<|assistant_end|><|bos|>Once upon a time there was a girl who loved to explore.
  11. agent 1.82
    arith.py (1 replacement)<|tool_end|><|assistant_start|><|tool_call_start|>shell<|arg|>command=python3 test
  12. story 1.78
    to `ops.py`.<|assistant_end|><|bos|>Once there was a little boy who loved to play with