Feature #1282
Fires on “("” (not labeled yet: read the examples)
- Fires on
- 0.52% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 38%
- agent 20%
- python 18%
- chat 17%
- worksheet 7%
Makes the model say
schema* its⏎ RenamedreplaceAllAnsweroldString
Makes it not say
se. big play toys boy named7
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 2.88tiny language model trained from scratch on a laptop.
-
python 2.82from greetings import count_vowels, hello⏎⏎assert count_vowels("house") ==
-
python 2.823⏎assert size("hello") == 5⏎assert initial("banana") == "
-
python 2.82⏎assert count_vowels("hello") == 2⏎assert initial("sun") == "
-
chat 2.54.<|assistant_end|><|user_start|>tell me a story about a boat<|user_end|><|assistant_start|>Once upon a time, there
-
python 2.48import last_letter, vowels, reverse⏎⏎assert last_letter("apple") == "
-
python 2.48_letter("river") == "r"⏎assert count_vowels("star") ==
-
python 2.47⏎assert backwards("pizza") == "azzip"⏎assert backwards("lemon") == "
-
python 2.47# main.py⏎from strings import shout⏎⏎print(shout("river"))⏎⏎
-
chat 2.467.<|assistant_end|><|bos|><|system_start|>Answer in one short sentence.<|system_end|><|user_start|>Once upon a time...
-
chat 2.45happily ever after.<|bos|><|user_start|>Tell me a story.<|user_end|><|assistant_start|>Once upon a time, there
-
python 2.45⏎⏎assert initial("hello") == "h"⏎assert initial("river") == "