Skip to content
mini-lab
Features of prelude-2

Feature #1148

Fires on “ lived” (not labeled yet: read the examples)

Fires on
0.50% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 55%
  • story 24%
  • agent 14%
  • chat 5%
  • worksheet 2%

Makes the model say

pythonAddedMITtxt happilypytest)`.schema

Makes it not say

said,"0.1th6 "

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.17
    and shared them with their friends. And they all lived happily ever after.
  2. story 3.13
    work together, you can do anything. And they all lived happily in their h
  3. story 3.07
    were kind and helped each other when they needed it. And they all lived happily together.<|bos|>
  4. story 3.05
    all the adventures she could have with her toys. And they all lived happily ever after.
  5. story 3.05
    welcoming was the best way to make friends. And they all lived happily ever after.
  6. story 3.01
    nament stayed safe and shiny on the tree. And they all lived happily ever after.
  7. story 3.01
    with her name on it to play with her friend again. And they lived happily ever after.
  8. chat 3.01
    , he was a great sailor and a good friend. And they all lived happily ever after.
  9. story 2.99
    of the sun. And they all lived happily in the big
  10. story 2.99
    to find the yummy red balls when they were hungry. And they all lived happily ever after.
  11. story 2.95
    unusual sheep. They played together and became best friends. And they all lived happily ever after.
  12. story 2.94
    both dogs became friends and played together with their toys. And they all lived happily ever after.