Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2576

Fires on “⏎” (not labeled yet: read the examples)

Fires on
0.78% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 77%
  • story 12%
  • chat 7%
  • python 3%
  • worksheet 0%

Makes the model say

])` legs):aei ==aeioudemoschema

Makes it not say

she3 girl herOnce happy toys soft

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.76
    he saw a big, tall tree and wanted to climb it.⏎His friends were scared,
  2. chat 1.68
    .<|user_end|><|assistant_start|>Once upon a time, there was a dog. His name was Sc
  3. story 1.63
    Speedy. Speedy loved to go fast. He would speed down the
  4. story 1.6
    busy robot named Robby. Robby liked to count. He counted everything he saw
  5. agent 1.5
    1-4⏎1: from text import vowels⏎2: ⏎3: WORD =
  6. story 1.49
    . Zoom loved to go fast up and down the big mountain. He would zoom all day
  7. agent 1.46
    1-4⏎1: from text import initial⏎2: ⏎3: WORD =
  8. agent 1.46
    4⏎1: from math_utils import magnitude⏎2: ⏎3: NUMBER =
  9. agent 1.45
    1-4⏎1: from tools import largest⏎2: ⏎3: VALUES =
  10. agent 1.44
    1-4⏎1: from lists import doubled⏎2: ⏎3: NUMBERS =
  11. chat 1.44
    .<|user_end|><|assistant_start|>Once upon a time, there was a dog. His name was Sc
  12. agent 1.43
    1-4⏎1: from lib import factorial⏎2: ⏎3: COUNT