Feature #3642
Fires on “```” (not labeled yet: read the examples)
- Fires on
- 0.21% of tokens
- Mostly in
- agent
- Layer
- after block 4
Where it fires
- agent 50%
- python 31%
- story 14%
- chat 4%
- worksheet 0%
Makes the model say
aboutatnyc what eggs were
Makes it not say
knocked_ codefrom<|tool_end|>CreatedSetboard
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 2.74```<|assistant_end|><|bos|><|system_start|>tools
-
python 2.74```⏎⏎>>> only
-
agent 2.74```<|assistant_end|><|bos|>17
-
python 2.74```python⏎def echo
-
agent 2.74```<|assistant_end|><|bos|><|user_start|>I
-
agent 2.74```<|assistant_end|><|bos|><|system_start|>tools
-
python 2.74```⏎⏎`factorial
-
agent 2.74```<|assistant_end|><|bos|><|system_start|>tools
-
python 2.74```python⏎def mean
-
python 2.74```⏎⏎Fix:
-
agent 2.74```<|assistant_end|><|bos|>Once upon
-
python 2.74```⏎<|bos|>Bug: