Skip to content
mini-lab
Features of prelude-2

Feature #1448

Fires on “ and” (not labeled yet: read the examples)

Fires on
0.27% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 60%
  • chat 31%
  • story 4%
  • agent 4%
  • python 2%

Makes the model say

? plus help what positive found?"

Makes it not say

day7Mom.read main way J

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 4.38
    9 = 654.⏎If you add 1 and 341
  2. worksheet 4.31
    8 = 7964.⏎If you add 9 and 840
  3. worksheet 4.18
    7749.⏎If you add 635 and 944
  4. worksheet 4.16
    = 49295.⏎If you add 7 and 724
  5. worksheet 4.14
    54 equals 957.⏎If you add 8 and 1, you
  6. worksheet 4.13
    = 5913.⏎If you add 16 and 340
  7. worksheet 4.12
    = 6441.⏎If you add 10 and 5, you
  8. worksheet 4.06
    7 is 9003.⏎If you add 7 and 376
  9. worksheet 4.06
    3 equals 8468.⏎If you add 9 and 876
  10. worksheet 4.03
    3 = 5272.⏎If you add 9 and 93,
  11. worksheet 3.99
    answer is 53.<|assistant_end|><|bos|>If you add 35 and 1, you
  12. worksheet 3.98
    568.⏎If you add 1517 and 955