Skip to content
mini-lab
Features of prelude-2

Feature #970

Fires on “ the” (not labeled yet: read the examples)

Fires on
0.58% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 63%
  • story 25%
  • chat 9%
  • python 3%
  • worksheet 1%

Makes the model say

typopatternvowels<|assistant_end|>chedreplaceAllch %

Makes it not say

give wish sure feel more⏎ felt other

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.92
    were very happy and tired. They went home, excited to play again the next day.<|bos|>
  2. story 2.85
    , and slept. She dreamed of playing with her friends again the next day.<|bos|>
  3. story 2.65
    ⏎And they both went home, excited to spin in the shade again the next day.<|bos|>
  4. story 2.61
    , a big, friendly dog came up to him. The dog wagged its tail and barked at
  5. story 2.51
    While he was walking, Tim met a friendly dog. The dog wagged its tail and barked.
  6. agent 2.38
    py<|tool_call_end|><|assistant_end|><|tool_start|>STAR⏎banana⏎<|tool_end|><|assistant_start|>Fixed the typo in `script
  7. chat 2.34
    ze this!"⏎Little
  8. story 2.34
    . "Why don't you try it too?"⏎Alice clapped her hands in the middle
  9. story 2.33
    a green frog. The frog could dance! The baby laughed and clapped his hands. "F
  10. agent 2.3
    3 main.py<|tool_call_end|><|assistant_end|><|tool_start|>CAT⏎<|tool_end|><|assistant_start|>Fixed the typo in `main
  11. agent 2.3
    python3 script.py<|tool_call_end|><|assistant_end|><|tool_start|>24⏎<|tool_end|><|assistant_start|>Fixed the typo in `script
  12. agent 2.29
    3 app.py<|tool_call_end|><|assistant_end|><|tool_start|>False⏎4⏎<|tool_end|><|assistant_start|>Fixed the typo in `app