Skip to content
mini-lab
Features of prelude-2

Feature #49

Fires on “ of” (not labeled yet: read the examples)

Fires on
0.72% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 40%
  • python 31%
  • worksheet 11%
  • chat 10%
  • story 8%

Makes the model say

at sun-ensed play one

Makes it not say

=**/*.emo uponICalculator_$new

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 3.5
    sum of the numbers in
  2. worksheet 3.5
    sum of 68
  3. python 3.21
    had met that day.<|bos|>`total(nums)` returns the sum of the numbers in nums
  4. worksheet 2.95
    _core.py⏎all tests passed⏎<|bos|>What is the sum of 735
  5. worksheet 2.91
    acc + i⏎ return acc⏎```⏎<|bos|>What is the sum of 52 and
  6. chat 2.89
    main.py⏎[4]⏎<|bos|><|user_start|>What is the sum of 858
  7. chat 2.86
    <|bos|><|system_start|>Answer with the number only.<|system_end|><|user_start|>Find the sum of 417
  8. worksheet 2.86
    7, 79<|think_end|>79<|assistant_end|><|bos|>What is the sum of 409
  9. chat 2.82
    _of(a, b)`.<|assistant_end|><|bos|><|user_start|>What is the sum of 5 and
  10. python 2.82
    88.<|assistant_end|><|bos|>Bug: `add` should return the sum of a and b,
  11. worksheet 2.81
    together is much more fun than playing alone.<|bos|>What is the sum of 1 and
  12. chat 2.81
    <|system_start|>Start every answer with "Sure!".<|system_end|><|user_start|>What is the sum of 637