Skip to content
mini-lab
Features of prelude-2

Feature #1917

Fires on “ toy” (not labeled yet: read the examples)

Fires on
1.55% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 64%
  • agent 14%
  • chat 14%
  • python 4%
  • worksheet 4%

Makes the model say

that idea to owny dog like but

Makes it not say

end<|assistant_end|><|tool_end|> equals return=**/*.'<|bos|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.07
    a time, there was a little girl named Sue. Sue had a pet cat named Fluffy.
  2. story 3.73
    there lived a little boy named Tim. Tim had a toy box that he loved
  3. story 3.66
    playing knights and dragons in the garden. Lily had a wooden sword and Ben
  4. story 3.65
    a time, there was a small boy named Tim. Tim had a penny that he loved
  5. chat 3.65
    a time, there was a young girl named Lily. She had a sister named Rose.
  6. story 3.54
    upon a time, there was a boy named Tim. Tim had a rope. He loved to
  7. chat 3.53
    a time, there was a little boy named Tim. Tim had a toy gun. He liked
  8. story 3.52
    boy named Tim. He had a toy ghost that he loved
  9. story 3.5
    a time, there was a smart man named Tom. Tom had a wife named Sue.
  10. story 3.47
    time, there was a little girl named Lily. Lily had a new watch. She loved her
  11. story 3.46
    little boy named Tom. Tom had a big, old dog named
  12. chat 3.4
    upon a time, there was a girl named Sally. Sally had a plan. She wanted to