Skip to content
mini-lab
Features of prelude-2

Feature #1147

Fires on “ number” (not labeled yet: read the examples)

Fires on
0.47% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 33%
  • chat 29%
  • agent 25%
  • python 9%
  • story 4%

Makes the model say

_ problemon countL brother of trees

Makes it not say

4 plus3 "!" passesbedperedance

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.9
    1 function: `tail(items)`.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
  2. chat 3.73
    198<|think_end|>198<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
  3. chat 3.72
    a + " " + b⏎```⏎<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
  4. chat 3.72
    story, or some numbers to add?<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
  5. chat 3.7
    583<|think_end|>583<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
  6. chat 3.69
    answer is 1706.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
  7. python 3.69
    gone forever, and the town was never the same again.<|bos|># number_utils.py
  8. chat 3.69
    ):⏎ return x in items⏎```⏎<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
  9. chat 3.68
    , ready for another day of fun together.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
  10. chat 3.65
    6 = 98926.<|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
  11. chat 3.64
    ⏎```<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>
  12. chat 3.62
    (s)`. The tests pass now.<|assistant_end|><|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>