Skip to content
mini-lab
Features of prelude-2

Feature #320

Fires on “ Mia” (not labeled yet: read the examples)

Fires on
0.84% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 76%
  • chat 20%
  • worksheet 2%
  • agent 1%
  • python 1%

Makes the model say

loved wanted liked was alwaysERined likes

Makes it not say

But butfact Butankt more call

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.93
    3 = 82.<|bos|>One day, a little girl named Sue went to the park
  2. story 4.89
    stories and add numbers.<|assistant_end|><|bos|>One day, a little girl named Sue found a bag of
  3. story 4.83
    answer is 8.<|assistant_end|><|bos|>One day, a little girl named Lily was playing with her
  4. story 4.77
    is 53.<|assistant_end|><|bos|>One day, a little girl named Mia went to the kitchen
  5. story 4.75
    2347 apples.<|bos|>One day, a little girl named Mia went for a walk
  6. story 4.74
    537.<|assistant_end|><|bos|>One day, a lively girl named Mia found a kay
  7. story 4.72
    vent further danger.<|bos|>One day, a little girl named Amy went to the park
  8. story 4.72
    ⏎```<|assistant_end|><|bos|>One day, a girl named Mia found an orange toy
  9. story 4.72
    is 25.<|assistant_end|><|bos|>One day, a little girl named Lily was troubled. She
  10. story 4.71
    1021.<|bos|>One day, a little girl named Amy was sad. She
  11. story 4.7
    the sun began to set.<|bos|>One day, a little girl named Sue went to the park
  12. story 4.7
    1520.<|bos|>One day, a little girl named Lily went to the park