Skip to content
mini-lab
Features of prelude-2

Feature #2162

Fires on “i” (not labeled yet: read the examples)

Fires on
0.76% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 70%
  • story 13%
  • chat 10%
  • python 5%
  • worksheet 2%

Makes the model say

ardef libdayving itsve python

Makes it not say

day FluffyOnceth tooecho1 set

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.59
    . She loved to explore the outdoors, especially the nearby p
  2. story 3.47
    around and around. One day, the plate was feeling especially happy and so
  3. story 3.41
    for their snack time. Tim loved yogurt very much, especially the one with
  4. story 3.18
    , with all her favourite things. Jill especially loved a purple
  5. story 3.14
    an important lesson to be careful and prepared, especially when doing something
  6. story 2.94
    his teacher discussed new words. He was especially excited when his
  7. story 2.59
    so happy and sang a happy song. To show his appreciation, he tid
  8. story 2.43
    time there was a gray rabbit. The rabbit was very enthusiastic. Every day
  9. story 2.42
    of you, Anna. I'm sure the rabbit will appreciate that. Come
  10. story 2.41
    , there were many things to play with. There were balls, bikes, and even
  11. chat 2.39
    <|assistant_start|>Hello! How can I help you today?<|assistant_end|><|user_start|>translate this into
  12. story 2.36
    there was a little dog named Max. Max was very enthusiastic. He loved