Skip to content
mini-lab
Features of prelude-2

Feature #2367

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.28% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 73%
  • chat 26%
  • agent 1%
  • worksheet 0%
  • python 0%

Makes the model say

truck big mtureavesis

Makes it not say

len False} thoughFalsenumber[- subtract

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 4.43
    Once upon a time, there was a large cat named Tom
  2. story 4.43
    Once upon a time, there was a lawyer.
  3. story 4.43
    _letter(s)`.<|assistant_end|><|bos|>Once upon a time, there was a big, noisy dragon
  4. story 4.41
    The tests pass now.<|assistant_end|><|bos|>Once upon a time, there was a little girl named Sue
  5. story 4.38
    if it makes noise again.<|bos|>Once upon a time, there was a big house. In
  6. story 4.35
    files in this project.<|assistant_end|><|bos|>Once upon a time, there was a little squirrel named Sam
  7. story 4.35
    py`.<|assistant_end|><|bos|>Once upon a time, there was a small hedge.
  8. story 4.34
    ```<|assistant_end|><|bos|>Once upon a time, there was a big factory.
  9. story 4.34
    files in this project.<|assistant_end|><|bos|>Once upon a time, there was a gifted little girl
  10. story 4.33
    : all tests passed.<|assistant_end|><|bos|>Once upon a time, there was a little girl named Lily
  11. story 4.33
    61799.<|bos|>Once upon a time, there was a little boy named Tim
  12. story 4.32
    is 70.<|assistant_end|><|bos|>Once upon a time, there was a small cat named Tom