Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1046

Fires on “.” (not labeled yet: read the examples)

Fires on
1.94% of tokens
Mostly in
worksheet
Layer
after block 4

Where it fires

  • worksheet 51%
  • python 16%
  • chat 15%
  • agent 14%
  • story 4%

Makes the model say

<|bos|>⏎<|assistant_end|> out. ink still

Makes it not say

4<|arg|>*5 listened8_*. equals

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. worksheet 6.29
    = 1316.⏎Ben had
  2. worksheet 6.21
    3344 = 3419.<|bos|><|user_start|>Hey,
  3. worksheet 6.09
    6 = 1560.⏎557
  4. worksheet 6.04
    So 75 + 340 = 415.<|bos|><|system_start|>tools:
  5. worksheet 6.04
    = 171.⏎45 plus
  6. worksheet 5.98
    = 623.⏎187
  7. worksheet 5.96
    424 = 2539.⏎Can you add
  8. worksheet 5.92
    = 21055.<|bos|><|user_start|>Where is
  9. worksheet 5.91
    ⏎So 29 + 76 = 105.<|bos|>Max had
  10. worksheet 5.9
    0 + 19 = 499.⏎I need to
  11. worksheet 5.89
    3070 = 3308.⏎Can you add
  12. worksheet 5.88
    3 = 560.⏎What is