Skip to content
mini-lab
Features of prelude-2

Feature #1673

Fires on “ upper” (not labeled yet: read the examples)

Fires on
1.76% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 50%
  • python 34%
  • story 12%
  • chat 4%
  • worksheet 1%

Makes the model say

upper= "?"ren ( of⏎ //

Makes it not say

Fixedit"`.Mom<|tool_end|><|bos|> door

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 6.44
    s + "!"<|tool_call_end|><|assistant_end|><|tool_start|>
  2. story 4.65
    someday.⏎
  3. agent 4.31
    s[::-1]<|tool_end|><|assistant_start|>
  4. python 4.27
    should add an exclamation mark to s, but it has `return s + "?"`.⏎⏎
  5. agent 4.13
    harness.<|system_end|><|user_start|>Add shout to greetings.py: it makes s upper case.<|user_end|><|assistant_start|>
  6. story 4.07
    made a loud siren noise. The
  7. story 4.06
    It's alright, Max. Maybe it will come back someday."⏎
  8. story 4.06
    ball. The ball had a symbol on it
  9. agent 4.03
    upper()<|tool_end|><|assistant_start|>`shout(s)` makes s upper case.<|assistant_end|><|user_start|>
  10. agent 4.0
    a function shout(s) to textlib.py. It makes s upper case."<|user_end|><|assistant_start|>
  11. story 3.99
    . One day, Tom found a new toy. It was a skeleton. Tom
  12. python 3.94
    s.lower()`.⏎⏎