Feature #530
Fires on “:” (not labeled yet: read the examples)
- Fires on
- 0.13% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 55%
- agent 33%
- chat 8%
- python 2%
- worksheet 1%
Makes the model say
s namerun best cat whole favoriteings
Makes it not say
happened equals from⏎ hissmallest in<|assistant_end|>
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 1.91aan(12, 2))⏎ ^^^^^⏎NameError: name 'mea
-
agent 1.87⏎ print(niitial(WORD))⏎ ^^^^^^^⏎NameError: name 'ni
-
agent 1.86print(posiitive(COUNT))⏎ ^^^^^^^^^⏎NameError: name 'pos
-
agent 1.82(count_vwels("river"))⏎ ^^^^^^^^^^^⏎NameError: name 'count_
-
agent 1.77([7, 9, 3]))⏎ ^^^^^^^⏎NameError: name 'adda
-
agent 1.75nius(5, 1))⏎ ^^^^^⏎NameError: name 'mn
-
agent 1.74⏎ print(reversse(WORD))⏎ ^^^^^^^^⏎NameError: name 'rever
-
agent 1.74print(keep_veen(NUMBERS))⏎ ^^^^^^^^^⏎NameError: name 'keep_
-
story 1.74said: "I'm so
-
agent 1.73(poower(3, 0))⏎ ^^^^^^⏎NameError: name 'poower
-
agent 1.73module>⏎ print(hllo("Bob"))⏎ ^^^^⏎NameError: name 'hllo
-
story 1.72, "Meow! I am lost. Can you help me find my home?" Sue did