Skip to content
mini-lab
Features of prelude-2

Feature #2682

Fires on “p” (not labeled yet: read the examples)

Fires on
0.54% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 52%
  • agent 35%
  • story 5%
  • python 5%
  • chat 3%

Makes the model say

shiny heavy top much big fell lot also

Makes it not say

project storynder(utilsAdded children_

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 2.53
    0: 3+0=3, 35269⏎So 3
  2. worksheet 2.48
    0: 7+0=7, 74973⏎So 7
  3. worksheet 2.47
    0: 3+0=3, 37234⏎So 3
  4. worksheet 2.45
    3: 0+3=3, 36665⏎So 5
  5. worksheet 2.43
    0+5=5, 56774⏎So 6
  6. agent 2.41
    .<|system_end|><|user_start|>In which file is cubed?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def
  7. worksheet 2.39
    0: 4+0=4, 45384⏎So 4
  8. agent 2.35
    ⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def
  9. agent 2.35
    ⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def
  10. agent 2.34
    .<|system_end|><|user_start|>In which file is tail?<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def
  11. agent 2.33
    ⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def
  12. agent 2.33
    ⏎AssertionError⏎⏎Exited with code 1<|tool_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def