Skip to content
mini-lab
Features of prelude-2

Feature #2887

Fires on “1” (not labeled yet: read the examples)

Fires on
0.69% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 44%
  • agent 44%
  • story 5%
  • worksheet 4%
  • chat 2%

Makes the model say

] home]`.]` returns woke0 grew

Makes it not say

assert Timultiplnderf!stide

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 7.45
    items⏎⏎⏎def last(items):⏎ return items[-1]⏎⏎⏎print
  2. python 7.37
    <|assistant_end|><|bos|>```python⏎def tail(items):⏎ return items[-1]⏎```⏎
  3. python 7.17
    ⏎⏎```python⏎def tail(items):⏎ return items[-1]⏎```⏎
  4. python 7.12
    (items)⏎⏎⏎def tail(items):⏎ return items[-1]⏎⏎⏎def
  5. python 7.01
    ⏎ return acc⏎⏎⏎def last(items):⏎ return items[-1]⏎⏎$
  6. python 7.0
    (items)⏎⏎⏎def last(items):⏎ return items[-1]⏎⏎⏎def
  7. python 6.93
    0]⏎⏎⏎def head(items):⏎ return items[0]⏎⏎⏎def
  8. python 6.9
    items[-1]⏎```⏎
  9. agent 6.87
    (nums)⏎⏎⏎def last(items):⏎ return items[-1]<|tool_call_end|><|assistant_end|><|tool_start|>
  10. agent 6.87
    s[::-1]<|tool_end|><|assistant_start|>`
  11. agent 6.84
    items):⏎2: return items[-1]⏎3:
  12. agent 6.79
    = return s[-1]<|arg|>newString=