Skip to content
mini-lab
Features of prelude-2

Feature #1113

Fires on “ was” (not labeled yet: read the examples)

Fires on
0.38% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 67%
  • chat 29%
  • agent 4%
  • python 1%
  • worksheet 0%

Makes the model say

Her?"g?Bug= a long

Makes it not say

edlistmyhepathou<|assistant_end|>ful

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.78
    opened the box together, the surprise was not broken.<|bos|>Once there was a man who was
  2. chat 4.66
    <|assistant_end|><|user_start|>Write a short story about a fish.<|user_end|><|assistant_start|>Once there was a dolphin who lived
  3. chat 4.62
    <|system_end|><|user_start|>I want a story about a cake!<|user_end|><|assistant_start|>Once there was a big, at
  4. chat 4.57
    calculator<|system_end|><|user_start|>Tell me a short story.<|user_end|><|assistant_start|>Once, there was a very cute and
  5. story 4.56
    90 = 109198.<|bos|>Once there was a little boy named
  6. story 4.56
    They were so happy that they had not been scared.<|bos|>Once there was a poor boy named
  7. story 4.52
    be friends and make the world a beautiful place.<|bos|>Once, there was a little boy named
  8. chat 4.51
    worried anymore."<|bos|><|user_start|>I want a story!<|user_end|><|assistant_start|>Once there was a kind man.
  9. story 4.5
    and 68 is 9448.<|bos|>Once there was a tree. It
  10. story 4.5
    Python files in this project.<|assistant_end|><|bos|>Once upon a time, there was a nosy bee named
  11. story 4.5
    little boy and a big fish surfing together.<|bos|>Once, there was a boy named Tim
  12. chat 4.49
    short story.<|user_end|><|assistant_start|>Sure! Once upon a time, there was a unique bird.