Skip to content
mini-lab
Features of prelude-2

Feature #3506

Fires on “.” (not labeled yet: read the examples)

Fires on
0.11% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 64%
  • story 20%
  • agent 13%
  • chat 2%
  • worksheet 1%

Makes the model say

⏎ ."<|assistant_end|> Tom glFix paper wa

Makes it not say

False Inside have family they ateirementsscript

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 1.51
    ⏎⏎`count_vowels` returns the number of vowels in s. For example, `
  2. python 1.5
    )⏎```⏎⏎`smallest` returns the smallest number in nums. For example, `
  3. python 1.5
    "!"⏎```⏎⏎`excite` adds an exclamation mark to s. For example, `
  4. python 1.44
    .<|assistant_end|><|bos|>`double(x)` returns x doubled.⏎⏎```python
  5. python 1.44
    ⏎```⏎⏎`vowels` returns the number of vowels in s. For example, `
  6. story 1.43
    . Lily laughed and clapped her hands. They played all day until the sun went down. Fluffy
  7. python 1.43
    "!"⏎```⏎⏎`excite` adds an exclamation mark to s. For example, `
  8. python 1.41
    a - b⏎```⏎⏎`subtract` returns a minus b. For example, `
  9. story 1.4
    he could help his new friend. They played in the field until the sun went down.<|bos|>
  10. python 1.4
    "!"⏎```⏎⏎`exclaim` adds an exclamation mark to s. For example, `
  11. python 1.4
    <|bos|>`min_item(nums)` returns the smallest number in nums.⏎⏎```python
  12. python 1.39
    ⏎```⏎⏎`size` returns the number of characters in s. For example, `