Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1229

Fires on “ig” (not labeled yet: read the examples)

Fires on
1.25% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 75%
  • chat 10%
  • agent 10%
  • python 5%
  • worksheet 1%

Makes the model say

tree store return sc b plant where too

Makes it not say

script=**/*. typo<|user_start|><|think_start|>config <|system_end|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 6.18
    Claire. She was playing in her room and saw a figure on the ground
  2. chat 5.89
    <|user_end|><|assistant_start|>One day, a little fish named Tim saw a big octopus.<|assistant_end|>
  3. chat 5.87
    the park and slipped and fell. She started to cry and a figure came up to
  4. story 5.87
    sun. While he was hopping, he saw a strange object. It was
  5. chat 5.62
    a story about a car?<|user_end|><|assistant_start|>One day, a humble figure named Tom went
  6. story 5.5
    high he could go. As he climbed, he found a shiny object in the tree
  7. story 5.5
    the sky. One day, while flying, Blue saw a shiny object on the ground
  8. story 5.45
    happy.⏎One day, Kitty decided to dance on the furniture. She danced
  9. story 5.31
    saw a glimmer in the distance. He saw a figure walking towards him
  10. story 5.26
    ope. Hope loved to play with the furniture in her house
  11. story 5.22
    Fin lived in a beautiful reef with his family
  12. story 5.17
    . Tim liked to look at everything.⏎They saw a shiny object on the ground