Skip to content
mini-lab
Features of prelude-2

Feature #1391

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.11% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 80%
  • chat 12%
  • agent 6%
  • python 1%
  • worksheet 1%

Makes the model say

+? named also numbers<|tool_call_start|> friendpy

Makes it not say

letnderrWhenustratful

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.94
    a tall tree. One day, the bird found a long string with a big knot in
  2. story 1.83
    see a strange machine in the park. It has a big button and a big hole. A
  3. story 1.8
    other side.⏎Tim started to climb the wall, but he heard a loud bark. It
  4. story 1.76
    Tim was playing near his house. He saw a big red car with a loud sound. It
  5. story 1.64
    woods. He saw a big tree with a pattern on it
  6. chat 1.63
    a car!<|user_end|><|assistant_start|>Sure! One day, a big car had a boo-b
  7. story 1.63
    a bird that is not normal. It is big and white and has a long neck. It
  8. story 1.62
    Once upon a time, there was a big lion. The lion had a long tie. He
  9. story 1.6
    to shake the box.⏎When Max shook the box, he heard a bad sound. It
  10. story 1.57
    ball and bounce with the big ball.⏎But then, they hear a voice.⏎"
  11. story 1.54
    the store. They saw a big jar. It was deep and had a funny picture on it
  12. story 1.54
    dog named Max was in the park. He saw a big lion with a collar on its neck