Feature #1263
Fires on “,” (not labeled yet: read the examples)
- Fires on
- 0.36% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 71%
- chat 22%
- agent 7%
- python 1%
- worksheet 0%
Makes the model say
=**/oldStringag`: thank gigg happened
Makes it not say
6readest:5 orAs and
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.43<|assistant_end|><|bos|>Once upon a time, there was a big
-
story 4.42105<|think_end|>105<|assistant_end|><|bos|>Once upon a time, there was a little
-
chat 4.37you tell me a story about a dragon<|user_end|><|assistant_start|>Once upon a time, there was a pink
-
story 4.353, 39<|think_end|>39<|assistant_end|><|bos|>Once upon a time, there was a girl
-
chat 4.31tell me a story about a fish?<|user_end|><|assistant_start|>Once upon a time, in a big blue
-
chat 4.3tell me a story about a cake?<|user_end|><|assistant_start|>Once upon a time, there was a tall
-
story 4.3with `final_letter(s)`.<|assistant_end|><|bos|>Once upon a time, there was a big
-
chat 4.27<|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a large
-
story 4.26text.py`, line 1.<|assistant_end|><|bos|>Once upon a time, a bald man named
-
chat 4.26tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a girl
-
chat 4.25tell me a story about a princess?<|user_end|><|assistant_start|>Once upon a time, there was a princess
-
chat 4.25<|user_start|>Can you tell me a story?<|user_end|><|assistant_start|>Once upon a time, there was a sailor