Skip to content
mini-lab
Features of prelude-2

Feature #1274

Fires on “ years” (not labeled yet: read the examples)

Fires on
0.40% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 52%
  • chat 24%
  • agent 9%
  • worksheet 9%
  • python 6%

Makes the model say

old years function goodbye day beach alonear

Makes it not say

"pyto(" For many <

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.85
    there was a little boy called David. He was only three years old, but he
  2. story 4.8
    1.<|bos|>Once there was a girl called Lily. She was three years old and loved to
  3. story 4.72
    time there was a little girl called Millie. She was three years old and loved to
  4. story 4.62
    Once there was a little girl called Ruby. She was three years old and very play
  5. story 4.6
    , there was a little boy named Alex. He was three years old and he liked
  6. story 4.6
    was a little girl named Sharon. She was only three years old. She had
  7. chat 4.57
    upon a time, there was a girl called Sam. She was three years old and her parents
  8. story 4.55
    time, there was a little girl named Lucy. She was just three years old and she was
  9. story 4.54
    Fred, even if it was raining outside.<|bos|>Mia was three years old and she was
  10. story 4.52
    upon a time there was a little boy called Billy. He was three years old and loved to
  11. story 4.51
    upon a time, there was a boy named Jack. Jack was three years old and he was
  12. story 4.51
    upon a time there was a little boy called Jack. He was three years old and he was