Skip to content
mini-lab
Features of prelude-2

Feature #480

Fires on “ if” (not labeled yet: read the examples)

Fires on
0.79% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 54%
  • agent 30%
  • python 10%
  • chat 5%
  • worksheet 2%

Makes the model say

fl just tinyP e preludebackwards[

Makes it not say

assert threwHey story remember upon "rement

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.18
    even more fun.<|bos|>
  2. chat 3.16
    ⏎They played and had fun in the sand. Tim learned that even if something looks stupid,
  3. story 2.89
    Tom learned that sometimes, even when things seem bad,
  4. story 2.87
    was overwhelmed with joy. She realised that even if you don't always
  5. chat 2.82
    ⏎They played and had fun in the sand. Tim learned that even if something looks stupid,
  6. chat 2.8
    ⏎They played and had fun in the sand. Tim learned that even if something looks stupid,
  7. story 2.74
    scared of everything. One
  8. story 2.74
    scared. I'm just
  9. story 2.74
    scared and it started to
  10. story 2.68
    from that day on, Spot and Tim always helped each other when things were hard.<|bos|><|system_start|>
  11. story 2.55
    little cat and the big dog became best friends. They learned that even if someone looks different,
  12. chat 2.37
    avy boat. They sailed the sea and had many fun adventures. Even though Tom could not hear