Feature #763
Fires on “ there” (not labeled yet: read the examples)
- Fires on
- 0.30% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 45%
- agent 39%
- chat 14%
- python 1%
- worksheet 0%
Makes the model say
ME element==**/ememberassert metER
Makes it not say
backing girled awayies were take
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 3.19<|user_end|><|assistant_start|>Sure! Once upon a time, in a small house, there was a wise
-
story 3.01.<|assistant_end|><|bos|>Once upon a time, in a quiet little house, there was a small stove
-
chat 2.95fish?<|user_end|><|assistant_start|>Once upon a time, in a big blue sea, there was a dependable
-
story 2.93⏎<|bos|>Once upon a time, in a small, humble house, there lived a little
-
story 2.91<|assistant_end|><|bos|>Once upon a time, in a tidy little house, there lived a young boy
-
story 2.9<|assistant_end|><|bos|>Once upon a time, in a bright, sunny house, there lived a little girl
-
story 2.89bird.<|bos|>Once upon a time, in a tidy little house, there lived a boy named
-
story 2.89"!"⏎```⏎<|bos|>Once upon a time, in a small house, lived a charming cat
-
story 2.89a story!<|assistant_end|><|bos|>Once upon a time, in a small house, there was a little
-
chat 2.83the sea!<|user_end|><|assistant_start|>Once upon a time, in a big sea, there was a little
-
story 2.8park.<|bos|>Once upon a time, in a lovely little house, there lived a hunter
-
chat 2.79?<|user_end|><|assistant_start|>Once upon a time, in a big blue sea, there was a dependable fish