Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2474

Fires on “ is” (not labeled yet: read the examples)

Fires on
0.20% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 51%
  • chat 34%
  • story 9%
  • agent 5%
  • python 1%

Makes the model say

were the was having even - get

Makes it not say

<|think_end|>)`..ge ipo you<|user_start|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.33
    8 + 6 = 22314.⏎What is the sum of
  2. worksheet 4.33
    54 + 63 = 917.⏎What is 790
  3. worksheet 4.31
    3150 = 88009.⏎What is the sum of
  4. worksheet 4.2
    3 = 560.⏎What is 103
  5. worksheet 4.2
    2381 is 9450.⏎What is 50 +
  6. worksheet 4.2
    8 plus 9 equals 37.⏎What is 507
  7. worksheet 4.19
    765 equals 103183.⏎What is 504
  8. worksheet 4.17
    84 is 10661.⏎What is 2 +
  9. worksheet 4.12
    5898 = 5907.⏎What is 835
  10. worksheet 4.12
    7275 = 12039.⏎What is 66 +
  11. worksheet 4.09
    plus 71 equals 77973.⏎What is 965
  12. worksheet 4.07
    3639 = 96590.⏎What is the sum of