Skip to content
mini-lab
Features of prelude-2

Feature #1692

Fires on “ a” (not labeled yet: read the examples)

Fires on
0.47% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 57%
  • chat 19%
  • agent 16%
  • python 7%
  • worksheet 2%

Makes the model say

lastlistDlltail cr DOkay

Makes it not say

and bird Now now something that how,"

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 6.25
    story about a cat!<|user_end|><|assistant_start|>One day, a big cat and a little dog were playing
  2. story 5.8
    .py⏎all tests passed⏎<|bos|>One day, a cat and a dog went to play
  3. story 5.75
    py⏎all tests passed⏎<|bos|>One day, a big cat and a small dog were playing
  4. chat 5.72
    Write a story for me.<|user_end|><|assistant_start|>One day, a cat and a dog were walking.
  5. story 5.57
    together at the park every day.<|bos|>One day, a cat and a dog were playing with
  6. story 5.5
    44766.<|bos|>One day, a cat and a dog had a qu
  7. story 5.47
    a zipper is.<|bos|>One day, a big dog and a little cat went to
  8. story 5.39
    46720.<|bos|>One day, a big cat and a small dog were playing
  9. chat 5.17
    a story about a dog!<|user_end|><|assistant_start|>One day, a dog and a boy went for a
  10. story 5.06
    correctly.<|bos|>One day, a big cat and a small dog were playing
  11. story 4.96
    asking me for a story!<|assistant_end|><|bos|>One day, a cat and a dog were playing together
  12. chat 4.78
    a story about a dog?<|user_end|><|assistant_start|>One day, a cat and a dog were playing.