Skip to content
mini-lab
Features of prelude-2

Feature #397

Fires on “it” (not labeled yet: read the examples)

Fires on
0.21% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 32%
  • python 28%
  • story 21%
  • chat 17%
  • worksheet 1%

Makes the model say

project") files thinkit Python more last

Makes it not say

you about down with're She as import

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 3.1
    . They looked by the flowers, but the toy was not there either. The little
  2. story 2.92
    . He looked in his toy box, but it was not there either. Tim felt
  3. story 2.74
    !" The other animals looked and looked but could not find Zara either.⏎Finally
  4. story 2.67
    "Do you want this? I can't peck at it either."⏎The
  5. agent 2.57
    ⏎```⏎0⏎```<|assistant_end|><|user_start|>good morning<|user_end|><|assistant_start|>Hello! How can I help
  6. story 2.48
    the yard. He is not wild, but he is not good either. He need
  7. chat 2.44
    Python files in this project.<|assistant_end|><|bos|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! Would you like
  8. story 2.42
    ighs. She is not angry, but she is not happy either. She hugs
  9. chat 2.42
    30⏎1⏎```<|assistant_end|><|bos|><|user_start|>Hi<|user_end|><|assistant_start|>Hi there! Would you like
  10. chat 2.41
    .py`, line 5.<|assistant_end|><|bos|><|user_start|>Hey<|user_end|><|assistant_start|>Hello! How can I help
  11. chat 2.38
    <|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Hi!<|user_end|><|assistant_start|>Hi there! Would you like
  12. chat 2.38
    .<|assistant_end|><|bos|><|system_start|>tools: calculator<|system_end|><|user_start|>Hey<|user_end|><|assistant_start|>Hi there! Would you like