Skip to content
mini-lab
Features of prelude-2

Feature #2829

Fires on “ with” (not labeled yet: read the examples)

Fires on
1.12% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 81%
  • chat 11%
  • python 3%
  • agent 3%
  • worksheet 2%

Makes the model say

their his fun there her There floor little

Makes it not say

json trainedationcommandabedopencodeage

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.56
    outside to play with his toy.⏎
  2. story 3.38
    tell short stories and add numbers.<|assistant_end|><|bos|>Ben and Lily were playing with their toys in the
  3. story 3.11
    a little girl named Lucy was playing in her room. She was playing with her dolls and having
  4. story 3.07
    friend and left, feeling much less worried.<|bos|>Billy was playing with his sack when his
  5. chat 3.05
    One day, Ben was playing with his best friend,
  6. story 3.05
    8.<|assistant_end|><|bos|>One day, a little girl named Lily was playing with her toy aut
  7. story 3.04
    main.py`.<|assistant_end|><|bos|>Lily and Ben are playing in the park with their gray dog,
  8. story 3.02
    items)`. The tests pass now.<|assistant_end|><|bos|>Lily and Ben are playing with blocks. They like
  9. story 3.01
    `evens` in this project.<|assistant_end|><|bos|>Lily and Ben were playing with soap bubbles in the
  10. story 3.0
    were playing with the shiny ob
  11. story 2.99
    !"<|user_end|><|assistant_start|>You're welcome!<|assistant_end|><|bos|>Lily and Ben are playing with blocks in the living
  12. story 2.95
    . One day, he went to the park to play with his friends. They