Skip to content
mini-lab
Features of prelude-2

Feature #1259

Fires on “ in” (not labeled yet: read the examples)

Fires on
0.23% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 75%
  • chat 10%
  • agent 10%
  • python 3%
  • worksheet 2%

Makes the model say

We their parkWe we had moment they

Makes it not say

pleasecommandboard multipl uponexpression surePlease

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.71
    At the park, Mia
  2. story 2.46
    tell short stories and add numbers.<|assistant_end|><|bos|>Tom and Mia were playing in the park. They
  3. story 2.4
    in `main.py`.<|assistant_end|><|bos|>Lily and Ben are playing in the park with their
  4. story 2.38
    ` and `ops.py`.<|assistant_end|><|bos|>Tom and Lily were playing in their room. They
  5. story 2.34
    function: `absolute(x)`.<|assistant_end|><|bos|>Tom and Lily were playing in the park. They
  6. story 2.25
    Tim watched carefully and tried to do it too.⏎At first, Tim had
  7. story 2.25
    items)`. The tests pass now.<|assistant_end|><|bos|>Lily and Ben are playing with blocks. They like
  8. story 2.2
    .⏎At last, he heard
  9. story 2.2
    day giving pieces of the fruit to everyone.⏎At the end of the day, all
  10. story 2.2
    .<|bos|>Once upon a time, there were two little girls playing on a lawn.
  11. story 2.17
    ! Have a nice day.<|assistant_end|><|bos|>Anna and Ben were playing in the snow. They
  12. story 2.15
    ` with `increment(x)`.<|assistant_end|><|bos|>Ben and Lily were playing in the park. They