Skip to content
mini-lab
Features of prelude-2

Feature #134

Fires on “ and” (not labeled yet: read the examples)

Fires on
1.48% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 83%
  • chat 8%
  • agent 5%
  • worksheet 2%
  • python 1%

Makes the model say

Once boths Together insteadx[- agreed

Makes it not say

=**/*. coming<|assistant_end|>lowertereadan<|think_end|>

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 5.12
    to eat. He asked Jack if he wanted some, but Jack just continued to
  2. story 3.8
    't mind. He picked up the ball and gave it to Sally. She was so happy and
  3. story 3.74
    the toy in his sack. He gave it to the boy. The boy was happy. The
  4. story 3.43
    happy to find the coin.⏎Amy showed the coin to Max, and he wagged his tail
  5. story 3.38
    so he gave her the shiny tire from his red car. The girl was very happy,
  6. story 3.37
    found a toy to give to Max. He gave Max the toy, and Max helped Tom put
  7. story 3.31
    a plan. He told Sam to find a big box. Sam was excited and ran
  8. story 3.27
    told Tommy they could see bigger bubbles if they went to the pond. Tommy smiled and the two
  9. story 3.22
    was the best toy of all. Spot gave the toy to Tim, and Tim felt very happy
  10. story 3.22
    bread. Tim went to the squirrel and gave it the bread. The squirrel was very happy and
  11. story 3.18
    was scared of Tom.⏎Tim gave his toy car to Tom. Tom took the car and
  12. story 3.15
    and had an idea. She found another ball and kicked it to Mimi. Mimi saw the new