Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #552

Fires on “<|user_start|>” (not labeled yet: read the examples)

Fires on
0.76% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 39%
  • chat 23%
  • story 22%
  • python 14%
  • worksheet 2%

Makes the model say

s plusakingingsjoinite usant

Makes it not say

Wow lovedread liked's table done be

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.21
    would be hard, but they wanted to try.⏎The ants worked as a team to carry
  2. story 1.92
    <|bos|>Once upon a time, there were two friends called Ant and Bee. One day
  3. python 1.73
    lemon")⏎"n"⏎⏎`whisper(s)` returns s in lower case.
  4. python 1.71
    return s + "!"⏎```⏎⏎`excite` returns s with an exclamation mark
  5. chat 1.68
    story about a cat!<|user_end|><|assistant_start|>One day, a big cat and a little dog were playing
  6. chat 1.66
    <|user_start|>What is 6
  7. agent 1.66
    <|user_start|>Create stats.py
  8. agent 1.66
    <|user_start|>Run the tests in
  9. agent 1.66
    <|user_start|>"Why does main
  10. agent 1.66
    <|user_start|>What does hello.
  11. chat 1.66
    <|user_start|>What are you good
  12. agent 1.66
    <|user_start|>Please which functions are