Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1800

Fires on “ated” (not labeled yet: read the examples)

Fires on
0.21% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 75%
  • agent 14%
  • chat 7%
  • python 3%
  • worksheet 1%

Makes the model say

in there b becauseves liked alone just

Makes it not say

#<|tool_call_end|> turns "ation<|user_start|>"_*.

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.35
    the other animals cheered for Pinky. Soon, Pinky could jump just as high as Bunny
  2. agent 2.14
    a and b separated by a space.
  3. story 2.09
    key. They felt lonely.⏎They knocked on the wall that separated their rooms.
  4. agent 1.88
    <|assistant_start|>`combine(a, b)` returns a and b separated by a space.
  5. python 1.82
    : `join_words` should return a and b separated by a space,
  6. story 1.8
    ⏎One day, they saw a big hole in the fence that separated their houses. They
  7. story 1.77
    kind and said, "Yes, I can help you." He leaned to pick a leaf
  8. python 1.73
    .<|assistant_end|><|bos|>Bug: `combine` should return a and b separated by a space,
  9. agent 1.71
    file lib.py, write combine: it returns a and b separated by a space.
  10. chat 1.69
    together and have a rest."⏎The dog nodded and they both leaned against the tree
  11. chat 1.69
    <|user_end|><|assistant_start|>Today Bob went to the park. He stumbled on the grass as
  12. story 1.68
    at a store. Excitedly, James started jumping up and down.⏎