Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2982

Fires on “ they” (not labeled yet: read the examples)

Fires on
0.69% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 56%
  • story 31%
  • python 6%
  • worksheet 4%
  • chat 4%

Makes the model say

_<|think_end|>oldString)) Python %command⏎

Makes it not say

when hitst wereheo is park

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.57
    Tim was not selfish anymore. He shared his sugar with his friends and they all had fun together
  2. story 1.47
    dog became best friends. They learned that even if someone looks different, they can still be a
  3. story 1.44
    and proud, and it knew that it could do anything if it tried hard and practiced.<|bos|>
  4. story 1.44
    . So it quit waving in the wind and just hung there.⏎All the
  5. story 1.41
    not find food. The sta
  6. story 1.39
    said, "I like the rain too, but I don't like getting wet."⏎Bob
  7. chat 1.38
    . Tim was proud and knew that he could do anything if he tried hard.<|assistant_end|><|bos|><|system_start|>
  8. story 1.36
    did not like the bug. She told her friends about it, and they all made a plan
  9. story 1.35
    liked to jump and play near the pond. Ducky warned Froggy to be careful near
  10. chat 1.35
    didn't lose his ball. He said thank you to his friends and they all played together with
  11. story 1.31
    . She realised that even if you don't always win the game, you can still get
  12. story 1.28
    Lucy was happy. From that day on, Lucy always made sure to wipe her teddy