Feature #3482
Fires on “ many” (not labeled yet: read the examples)
- Fires on
- 0.10% of tokens
- Mostly in
- chat
- Layer
- after block 4
Where it fires
- chat 48%
- worksheet 36%
- agent 8%
- story 7%
- python 2%
Makes the model say
is + smallest thought tablely mean next
Makes it not say
_<|user_start|>ie"`.OneD$ For
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
chat 6.42has 71 coins. Lily gets 8 more coins. How many coins does Lily have
-
chat 6.2487 stars. Anna gets 872 more stars. How many stars does Anna have
-
worksheet 6.16274 apples. Tom gets 39 more apples. How many apples does Tom have
-
chat 6.1Sue has 3 cookies. Sue gets 4 more cookies. How many cookies does Sue have
-
chat 6.0970 shells. Tom gets 47 more shells. How many shells does Tom have
-
chat 6.0842 balls. Sue gets 18 more balls. How many balls does Sue have
-
worksheet 6.003 more stickers. How many stickers does Max have
-
worksheet 5.95has 61 cookies. Max gets 1 more cookies. How many cookies does Max have
-
chat 5.9263 coins. Sam gets 98 more coins. How many coins does Sam have
-
chat 5.9Mia has 8 stickers. Mia gets 2 more stickers. How many stickers does Mia have
-
chat 5.821 more coins. How many coins does Lucy have
-
chat 5.8Mia has 2 coins. Mia gets 6 more coins. How many coins does Mia have