Feature #3207
Fires on “ high” (not labeled yet: read the examples)
- Fires on
- 0.72% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 71%
- chat 14%
- python 10%
- agent 3%
- worksheet 2%
Makes the model say
high upap abher wings skyri
Makes it not say
<|assistant_end|>fact filesThis thisOncepered<|arg|>
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.47a time, there was a perfect bird. The bird loved to fly high in the sky.
-
story 5.25<|think_end|>968<|assistant_end|><|bos|>One day, a little plane was flying high in the sky.
-
story 5.23was a big, thick bird named Bobo. Bobo loved to soar high in the sky.
-
story 5.19upon a time, there was a goose. The goose liked to fly high in the sky.
-
story 5.11a time, there was a gray bird named Bobo. Bobo could fly high up in
-
chat 5.06Once upon a time, there was a big bird who could fly very high.<|assistant_end|><|bos|>4
-
story 5.01big kick. But this time, something strange happened. The ball flew high up into the sky
-
story 5.0a little bird named Blue. Blue loved to spread his wings and fly high in the sky.
-
story 4.9day, they all wanted to surprise him.⏎The little bird flew high and far to the
-
story 4.82very attractive with bright feathers. Blue loved to soar high in the sky and
-
story 4.8a flap of his wings!⏎One day, Tim was flying high in the sky when
-
story 4.73<|assistant_end|><|bos|>Once upon a time, a bird named Bob wanted to fly high in the sky.