Skip to content
mini-lab
Features of prelude-2

Feature #273

Fires on “ ” (not labeled yet: read the examples)

Fires on
0.82% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 35%
  • agent 31%
  • worksheet 18%
  • chat 15%
  • story 1%

Makes the model say

"()`Read1def `#

Makes it not say

A another gone anymore drove Now hungryMom

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 5.19
    length of s, but it has `return len(s) - 1`.⏎⏎
  2. python 5.02
    length of s, but it has `return len(s) - 1`.⏎⏎
  3. python 4.95
    ` should add one to x, but it has `return x - 1`.⏎⏎
  4. worksheet 4.95
    ⏎8+7: 8+7=15, 1592
  5. python 4.94
    add up all the numbers in nums, but it has `result = 1`.⏎⏎
  6. python 4.83
    number of items, but it has `return len(items) - 1`.⏎⏎
  7. python 4.8
    number of items, but it has `return len(items) - 1`.⏎⏎
  8. python 4.76
    ` should add one to x, but it has `return x - 1`.⏎⏎
  9. chat 4.75
    +8: 8+8=16, 167<|think_end|>
  10. python 4.75
    count the items, but it has `return len(items) - 1`.⏎⏎
  11. worksheet 4.68
    4⏎7+8: 7+8=15, 1581
  12. chat 4.58
    <|assistant_start|><|think_start|>8+9: 8+9=17, 17<|think_end|>The