Feature #110
Fires on “ because” (not labeled yet: read the examples)
- Fires on
- 0.20% of tokens
- Mostly in
- story
- Layer
- after block 4
Where it fires
- story 76%
- chat 12%
- agent 6%
- python 5%
- worksheet 2%
Makes the model say
def. walked anymorean she of sun
Makes it not say
<|tool_call_start|>Once file<|think_start|><|system_end|> "?"$oldString
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 4.26dy around and it was so peaceful. Sally found a rock to sit on and she watched the
-
story 3.55big tree. The tree had many seats for the bird to sit on.⏎One day
-
story 3.49a big pond. The insect was fearful because it could not swim
-
story 3.06It was sad because it had no friends
-
story 3.05jump and play in the water together. But the ugly frog felt sad because he looked different from
-
story 3.05small village, there was an ugly tree. The ugly tree was sad because all the other trees
-
story 3.05a good wash. The train could drive fast, but it was sad because it was dirty.
-
story 3.01Bow was walking in the yard. Bow was a troubled cat because he always lost his
-
story 3.0day, a small squirrel came to the wise owl. He was sad because he could not find
-
story 2.98girl named Amy. Amy had a toy rod that she loved to play with. One day,
-
story 2.98the water and make bubbles. One day, Ducky was very upset because he could not find
-
chat 2.97upon a time, there was a poor cat. The cat was sad because it did not have