Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1190

Fires on “ read” (not labeled yet: read the examples)

Fires on
0.69% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 63%
  • worksheet 15%
  • chat 11%
  • story 10%
  • python 1%

Makes the model say

che are iser set sayso best

Makes it not say

tenAddedcalculator add()https⏎ ()`

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. agent 3.35
    <|bos|><|system_start|>tools: edit, glob, grep, question, read, shell, sk
  2. agent 3.13
    <|bos|><|system_start|>tools: edit, glob, grep, question, read, shell, sk
  3. agent 3.04
    <|bos|><|system_start|>tools: edit, glob, grep, question, read, shell, sk
  4. story 3.01
    each other.<|assistant_end|><|bos|>Once upon a time, there was a little player named Tim.
  5. agent 3.01
    <|bos|><|system_start|>tools: edit, glob, grep, question, read, shell, sk
  6. agent 3.0
    <|bos|><|system_start|>tools: edit, glob, grep, question, read, shell, sk
  7. agent 2.97
    <|bos|><|system_start|>tools: edit, glob, grep, question, read, shell, sk
  8. agent 2.95
    <|bos|><|system_start|>tools: edit, glob, grep, question, read, shell, sk
  9. agent 2.95
    <|bos|><|system_start|>tools: edit, glob, grep, question, read, shell, sk
  10. agent 2.94
    <|bos|><|system_start|>tools: edit, glob, grep, question, read, shell, sk
  11. agent 2.94
    <|bos|><|system_start|>tools: edit, glob, grep, question, read, shell, sk
  12. agent 2.93
    <|bos|><|system_start|>tools: edit, glob, grep, question, read, shell, sk