Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3535

Fires on “One” (not labeled yet: read the examples)

Fires on
0.08% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 71%
  • chat 24%
  • agent 3%
  • worksheet 1%
  • python 1%

Makes the model say

uponOnce day# For pythonually plus

Makes it not say

each heone⏎rednumberdouble

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.86
    82347 apples.<|bos|>One day, a little
  2. story 5.76
    + 73 = 82.<|bos|>One day, a little
  3. story 5.59
    55499 = 57077.<|bos|>One day, a fast
  4. story 5.55
    29839 = 74763.<|bos|>One day, a little
  5. story 5.51
    843.<|assistant_end|><|bos|>One day, a boy
  6. story 5.47
    Now Lucy has 11626 toys.<|bos|>One day, a smart
  7. story 5.46
    2 + 475 = 477.<|bos|>One day, a little
  8. story 5.45
    3 + 769 = 772.<|bos|>One day, a little
  9. story 5.42
    ⏎So 4 + 89 = 93.<|bos|>One day, a big
  10. story 5.37
    4 + 907 = 1021.<|bos|>One day, a little
  11. story 5.34
    70 + 2 = 82672.<|bos|>One day, Joey
  12. story 5.3
    + 6385 = 8745.<|bos|>One day, a little