Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2052

Fires on “<|tool_start|>” (not labeled yet: read the examples)

Fires on
0.59% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 57%
  • chat 23%
  • story 16%
  • worksheet 3%
  • python 1%

Makes the model say

." but it was,"?" thought!"

Makes it not say

alseally = minitxt*room<|tool_call_end|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 4.43
    <|tool_start|>Read file core.
  2. agent 4.43
    <|tool_start|>Found 1 matches
  3. agent 4.43
    <|tool_start|>all tests passed⏎
  4. agent 4.43
    <|tool_start|>Traceback (most recent
  5. agent 4.43
    <|tool_start|>Read file lib.
  6. agent 4.43
    <|tool_start|>Found 1 matches
  7. agent 4.43
    <|tool_start|>Found 1 matches
  8. agent 4.43
    <|tool_start|>2⏎36
  9. agent 4.43
    <|tool_start|>Read file demo.
  10. agent 4.43
    <|tool_start|>Traceback (most recent
  11. agent 4.43
    <|tool_start|>Read file core.
  12. agent 4.43
    <|tool_start|>Read file main.