Skip to content
mini-lab
Features of prelude-2

Feature #108

Fires on “NUMBER” (not labeled yet: read the examples)

Fires on
0.30% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 73%
  • python 15%
  • story 11%
  • chat 1%
  • worksheet 0%

Makes the model say

positive0 understoodag everers<|arg|> work

Makes it not say

makes] Tim= return the there add

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.05
    LIMIT to 7<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=LIMIT =<|tool_call_end|><|assistant_end|><|tool_start|>
  2. agent 2.95
    4 for NUMBER.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=NUMBER =<|tool_call_end|><|assistant_end|><|tool_start|>
  3. agent 2.91
    OUNT to -7.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=COUNT =<|tool_call_end|><|assistant_end|><|tool_start|>
  4. agent 2.84
    and run the script please<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=VALUES =<|tool_call_end|><|assistant_end|><|tool_start|>
  5. python 2.82
    py⏎from math_utils import larger, sub_one⏎⏎COUNT = 6⏎
  6. python 2.82
    (x):⏎ return x % 2 == 1⏎⏎⏎NUMBER = 10
  7. agent 2.81
    al to 8.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=NUMBER =<|tool_call_end|><|assistant_end|><|tool_start|>
  8. agent 2.77
    LIMIT to 9<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=LIMIT =<|tool_call_end|><|assistant_end|><|tool_start|>
  9. python 2.76
    ⏎from listlib import evens, count⏎from ops import minus⏎⏎NUMBERS = [5,
  10. python 2.7
    py⏎from number_utils import magnitude, lower_of⏎⏎NUMBER = -9⏎
  11. agent 2.69
    run app.py.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=COUNT =<|tool_call_end|><|assistant_end|><|tool_start|>
  12. python 2.69
    .<|assistant_end|><|bos|># main.py⏎from items import biggest⏎⏎VALUES = [1,