Feature #124
Fires on “ take” (not labeled yet: read the examples)
- Fires on
- 1.35% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 83%
- chat 10%
- agent 7%
- worksheet 1%
- python 0%
Makes the model say
. away and things from, m when
Makes it not say
oldString calculator<|assistant_start|> function prelude<|arg|>Exitedexpression
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.48to get some candy from the
-
story 4.21named Tim was troubled. Today, he had to choose a toy to bring to school. He
-
story 4.17the squirrel find food.⏎Tim asked his mom for some food to give to the squirrel.
-
story 4.04ended up in a forest. She got out of the car to take a better look at
-
story 4.0an idea. He would pray for the poor man's skin to get better.⏎The
-
story 3.97it is very pretty. Let's put it in our beach bag to take home."⏎As
-
story 3.91hide. She found a temple that seemed like a perfect spot to stay hidden. She started
-
story 3.74bird named Lily near the lake. Lily had a razor to cut some ice. Ben
-
story 3.68the oak tree, there was a little pond where animals came to drink water and wash.
-
story 3.58. They had no more tea to drink and their house was
-
story 3.54!" the boy said. "Do you want some of my juice to drink?"⏎The deer
-
story 3.53to find the car. They chased the car because it was bad to take the food.⏎