Skip to content
mini-lab
Features of prelude-2

Feature #546

Fires on “ years” (not labeled yet: read the examples)

Fires on
0.39% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 74%
  • python 13%
  • story 10%
  • chat 2%
  • worksheet 1%

Makes the model say

i not sameown againdef pan happy

Makes it not say

("OneOnce "⏎ sumwordsase

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.63
    time there was a little girl called Millie. She was three years old and loved to
  2. story 2.46
    Fred, even if it was raining outside.<|bos|>Mia was three years old and she was
  3. story 2.44
    , there was a little boy named Alex. He was three years old and he liked
  4. story 2.43
    1.<|bos|>Once there was a girl called Lily. She was three years old and loved to
  5. story 2.42
    Once there was a little girl called Ruby. She was three years old and very play
  6. story 2.38
    a time there was a little boy named Dave. He was three years old. He was
  7. story 2.35
    upon a time, there lived a boy named Jack. He was three years old and loved to
  8. story 2.35
    there was a little boy called David. He was only three years old, but he
  9. story 2.31
    was a little girl named Sharon. She was only three years old. She had
  10. story 2.31
    upon a time there was a little boy called Jack. He was three years old and he was
  11. python 2.3
    The answer is 50.<|assistant_end|><|bos|># hello.py⏎from core import first,
  12. python 2.28
    The answer is 41.<|assistant_end|><|bos|># main.py⏎from text import echo⏎