Feature #2223
Fires on “ oyster” (not labeled yet: read the examples)
- Fires on
- 4.81% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 54%
- agent 29%
- chat 15%
- python 2%
- worksheet 0%
Makes the model say
less brokelendbo hungryone
Makes it not say
python =):python)⏎ Thank +
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 7.89they were happy.<|bos|>Once upon a time, there was an old oyster. The old oyster
-
story 7.67Once upon a time, in a big sea, there was a clumsy oyster. The oyster liked
-
story 7.35ing the wheel.<|bos|>Once upon a time, there was a little dolphin named Dolly.
-
story 7.35a calculator.<|assistant_end|><|bos|>Once upon a time, there was a fat dolphin. The dolphin liked
-
chat 7.07Once upon a time, in a big sea, there was a little oyster named Ollie.<|assistant_end|>
-
chat 7.03Once upon a time, in a big sea, there was a little oyster named Ollie.<|assistant_end|>
-
story 7.0.<|assistant_end|><|bos|>Sally hopped to the playground. She saw a giant maze.⏎"Wow
-
chat 6.98was a little boy named Tim. Tim loved to play with his football.<|assistant_end|><|user_start|>Hey
-
story 6.87feel the wind.⏎While sailing, the boat met a little oyster. The oyster said
-
chat 6.8Once upon a time, in a big sea, there was a little oyster named Ollie.<|assistant_end|>
-
story 6.71add numbers.<|assistant_end|><|bos|>Once upon a time, there was a big hoop. It was a
-
story 6.69house, there lived a little boy named Tim. Tim was scared of ghosts. One day