Skip to content
mini-lab
Features of prelude-2

Feature #213

Fires on “ always” (not labeled yet: read the examples)

Fires on
0.36% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 68%
  • agent 19%
  • chat 10%
  • python 2%
  • worksheet 0%

Makes the model say

example helpingFinally edit running always<|arg|> sometimes

Makes it not say

smalls_ sum called + if smaller

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.93
    a boy named Joe. He was jolly, loved to play and was always having fun. One
  2. story 3.6
    94.<|bos|>Mandy was a bald lady. She was always nice to everyone she
  3. story 3.56
    always remembered his big adventure
  4. story 3.53
    there was a little girl named Lucy. Lucy was a dependable girl who always kept her promises
  5. story 3.44
    there was a little boy who loved to go on adventures. He was always on the lookout
  6. story 3.43
    a little boy called Jack. He was three years old and he was always getting into silly trouble
  7. story 3.32
    but he was always careful to stay behind
  8. story 3.3
    , there was a nosy little bird. He had four wings and was always asking questions. One
  9. chat 3.25
    Once upon a time there was a little girl named Lucy. She was always curious and loved to
  10. story 3.23
    , always looking for new fun
  11. story 3.22
    loved riding in Tom's taxi, and he was always happy to help.
  12. story 3.2
    was on a street. Max was a very frustrated dog because he was always dirty. He wanted