Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #3545

Fires on “,” (not labeled yet: read the examples)

Fires on
0.41% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 85%
  • story 8%
  • python 3%
  • chat 2%
  • worksheet 2%

Makes the model say

Sorryischn anFixedx create

Makes it not say

want would?" Tim before. wants pond

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.21
    mbol he pinched!<|bos|><|system_start|>tools: edit, glob, grep, question
  2. agent 3.17
    and they were very happy.<|bos|><|system_start|>tools: edit, glob, grep, question
  3. agent 3.17
    to her very own garden!<|bos|><|system_start|>tools: edit, glob, grep, question
  4. agent 3.16
    friend, the little animal.<|bos|><|system_start|>tools: edit, glob, grep, question
  5. agent 3.16
    had eaten them all!<|bos|><|system_start|>tools: edit, glob, grep, question
  6. agent 3.16
    play together in the sky.<|bos|><|system_start|>tools: edit, glob, grep, question
  7. agent 3.16
    different fruit with each other.<|bos|><|system_start|>tools: edit, glob, grep, question
  8. agent 3.15
    You are the best cook!"<|bos|><|system_start|>tools: edit, glob, grep, question
  9. agent 3.13
    interests at heart.<|bos|><|system_start|>tools: edit, glob, grep, question
  10. agent 3.1
    is 85.<|assistant_end|><|bos|><|system_start|>tools: edit, glob, grep, question
  11. agent 3.1
    bright for everyone to see.<|bos|><|system_start|>tools: edit, glob, grep, question
  12. agent 3.09
    a tree was a ghost.<|bos|><|system_start|>tools: edit, glob, grep, question