Skip to content
mini-lab
Features of prelude-2

Feature #912

Fires on “```” (not labeled yet: read the examples)

Fires on
0.76% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 58%
  • worksheet 26%
  • agent 12%
  • story 3%
  • chat 2%

Makes the model say

pythonopencodepython =<|assistant_end|>commandtxtSo

Makes it not say

small it someer first a were are

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 3.03
    , 4, 4, 2])⏎4⏎<|bos|>```python⏎def odd
  2. python 2.98
    absolute(-4)` returns `4`.⏎⏎```python⏎def exclaim
  3. python 2.95
    has `return (a + b) / 3`.⏎⏎```python⏎def average
  4. python 2.93
    ")` returns `"cat"`.⏎⏎```python⏎def combine
  5. python 2.9
    it has `return sum(nums) / 2`.⏎⏎```python⏎def mean
  6. python 2.89
    "`.⏎⏎```python⏎def first
  7. python 2.86
    has `return (a + b) / 3`.⏎⏎```python⏎def mean
  8. python 2.86
    ])` returns `4`.⏎⏎```python⏎def only
  9. python 2.86
    it has `return sum(nums) / 2`.⏎⏎```python⏎def average
  10. python 2.85
    but it has `return x + x`.⏎⏎```python⏎def squared
  11. python 2.83
    6])` returns `6`.⏎⏎```python⏎def mean
  12. python 2.83
    it has `return len(s) + 1`.⏎⏎```python⏎def length