Skip to content
mini-lab
Features of prelude-2

Feature #2942

Fires on “ Every” (not labeled yet: read the examples)

Fires on
1.90% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 51%
  • story 27%
  • agent 16%
  • worksheet 6%
  • python 0%

Makes the model say

day morning after we gets calculatorday woke

Makes it not say

lower. shiny` Theyedwords but

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.87
    Once upon a time there a little boy, who was very happy. Every morning he would wake
  2. story 5.63
    forgot that special acorn.<|bos|>Pete was a happy rat. Every morning, he woke
  3. story 5.58
    a gray rabbit. The rabbit was very enthusiastic. Every day it would hop
  4. story 5.54
    was a girl. She was so calm and still like a lake. Every day she would go
  5. story 5.46
    ```⏎treetree⏎```<|assistant_end|><|bos|>Mummy was frustrated. Every day she was trying
  6. story 5.41
    there was a boy, Brian, who loved to learn. Every day he would sit
  7. story 5.24
    was a bald lady. She was always nice to everyone she met. Every day, Mandy
  8. story 5.19
    a time, there was a small bird named Mr Chirp. Every morning, Mr Ch
  9. story 5.13
    was a little girl named Mia. Mia was very persistent. Every day, she would
  10. story 5.03
    upon a time, there were two friends called Drew and Jack. Every day the two friends
  11. story 5.02
    time, there was a clumsy monkey who lived in a wonderful garden. Everywhere he looked he
  12. chat 4.97
    a time, there was a grumpy princess who lived in a castle. Every day the princess would