Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3296

Fires on “⏎” (not labeled yet: read the examples)

Fires on
0.82% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 52%
  • python 40%
  • story 5%
  • chat 2%
  • worksheet 1%

Makes the model say

def from<|assistant_end|> its resti fell ap

Makes it not say

Hi:iveHello done ==⏎⏎'m

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 4.74
    ))⏎⏎⏎test_number_
  2. agent 4.61
    % b == 0⏎⏎⏎def vowels(s
  3. agent 4.48
    (half(LIMIT))⏎⏎⏎def min_of
  4. agent 4.45
    newString=print(doubled(SCORES))⏎⏎⏎def smallest(nums
  5. agent 4.23
    (max_item([5, 2, 2]))⏎⏎⏎def first(items
  6. python 4.17
    in nums]⏎⏎⏎def add_all
  7. python 4.15
    (items, x):⏎ return x in items⏎⏎⏎def biggest(nums
  8. python 4.15
    (items, x):⏎ return x in items⏎⏎⏎def hello(name
  9. agent 4.15
    newString= return b⏎⏎⏎def positive(x
  10. python 4.13
    ):⏎ acc = acc + i⏎ return acc⏎⏎⏎def multiply(a
  11. python 4.09
    "!"⏎⏎⏎def join_words
  12. agent 4.08
    assert fact(3) == 6⏎⏎⏎main.py: