Skip to content
mini-lab
Features of prelude-2

Feature #224

Fires on “ and” (not labeled yet: read the examples)

Fires on
0.27% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 76%
  • story 22%
  • chat 2%
  • python 1%
  • worksheet 0%

Makes the model say

py): middle<|arg|>A putite another

Makes it not say

should( was long * without tri around

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.48
    's leaves.⏎Lily took some paper and put it on the
  2. story 2.27
    stick them on paper and make a story!"⏎They took some paper and glue and started to
  3. story 2.21
    , Sam, we are rich!" Ben says. He takes some money and puts it in his
  4. story 2.19
    all. She wanted to draw them all.⏎She took her colors and papers and
  5. story 2.08
    She wants to play with him. She takes the big box of cars and trucks to his house
  6. agent 2.07
    <|user_start|>"Which file defines mean?"<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def mean<|tool_call_end|>
  7. agent 2.05
    <|system_end|><|user_start|>Find the function exclaim.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def exclaim<|tool_call_end|>
  8. agent 2.03
    <|user_start|>Explain the function hello.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def hello<|tool_call_end|>
  9. story 2.03
    other. They decided to work together.⏎They picked up some sticks and stones. They
  10. agent 2.03
    <|user_start|>Find the function sum_list<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def sum_
  11. agent 2.02
    .<|system_end|><|user_start|>Rename welcome to greet<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=welcome<|tool_call_end|><|assistant_end|>
  12. agent 2.02
    <|system_end|><|user_start|>Find the function includes.<|user_end|><|assistant_start|><|tool_call_start|>grep<|arg|>pattern=def includes<|tool_call_end|>