Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1404

Fires on “⏎” (not labeled yet: read the examples)

Fires on
0.35% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 50%
  • agent 40%
  • story 8%
  • worksheet 1%
  • chat 1%

Makes the model say

Y thaten smiled else_)case

Makes it not say

wind"))jsonLily its everywheremd stuck

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 1.87
    only.<|system_end|><|user_start|>Add
  2. agent 1.87
    only knows small Python project
  3. chat 1.87
    only.<|system_end|><|user_start|>Add
  4. python 1.86
    of a and b, but it has `return a`.⏎⏎```python⏎def
  5. python 1.86
    , but it has `return a % b == 1`.⏎⏎```python⏎def
  6. python 1.81
    s`.⏎⏎```python⏎def
  7. python 1.79
    x * x` with `return x * x * x`.⏎⏎```python⏎def
  8. python 1.79
    ` with `return x // 2`.⏎⏎```python⏎def
  9. python 1.79
    aeio":` with `if c in "aeiou":`.⏎⏎```python⏎def
  10. python 1.79
    * a` with `return a * b`.⏎⏎```python⏎def
  11. python 1.78
    * 3` with `return x * x * x`.⏎⏎```python⏎def
  12. python 1.78
    0` with `return x % 2 == 1`.⏎⏎```python⏎def