Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1405

Fires on “g” (not labeled yet: read the examples)

Fires on
0.48% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 62%
  • story 30%
  • chat 4%
  • python 3%
  • worksheet 1%

Makes the model say

essgvesleswordstas

Makes it not say

= Python<|tool_call_end|>+lower moral < python

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.12
    living room. They like to build towers and houses and bridges with the blocks
  2. story 5.93
    of different colors. They can make towers, houses, bridges and more.
  3. agent 5.79
    harness.<|system_end|><|user_start|>Please show me the Python files.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern
  4. agent 5.75
    harness.<|system_end|><|user_start|>Show me the Python files.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern
  5. agent 5.74
    coding agent harness.<|system_end|><|user_start|>List the files.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern
  6. agent 5.74
    harness.<|system_end|><|user_start|>show me the Python files.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern
  7. agent 5.72
    agent harness.<|system_end|><|user_start|>"List the files."<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern
  8. agent 5.68
    1.<|assistant_end|><|user_start|>Please show me the Python files.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern
  9. agent 5.67
    .<|system_end|><|user_start|>"Show me the Python files."<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern
  10. agent 5.66
    <|system_end|><|user_start|>Please which Python files are in this project?<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern
  11. agent 5.66
    <|system_end|><|user_start|>Show me the files in this folder.<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern
  12. agent 5.64
    coding agent harness.<|system_end|><|user_start|>List the files please<|user_end|><|assistant_start|><|tool_call_start|>glob<|arg|>pattern