Feature #3832
Fires on “<|bos|>” (not labeled yet: read the examples)
- Fires on
- 0.49% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 48%
- story 16%
- chat 16%
- agent 14%
- worksheet 6%
Makes the model say
_```<|system_start|><|user_start|>⏎<|bos|>(bug
Makes it not say
5at42 something He I of
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
story 5.23⏎⏎$ python3 app.py⏎81⏎t⏎<|bos|>Once upon a time
-
chat 5.19⏎$ python3 test_words.py⏎all tests passed⏎<|bos|><|system_start|>tools: calculator
-
python 5.09⏎⏎$ python3 main.py⏎code cloud⏎1⏎<|bos|># LICENSE⏎MIT
-
python 5.06⏎$ python3 test_items.py⏎all tests passed⏎<|bos|>`product(a
-
story 5.02⏎$ python3 test_lib.py⏎all tests passed⏎<|bos|>One day, a
-
story 4.98⏎$ python3 test_core.py⏎all tests passed⏎<|bos|>Once upon a time
-
story 4.97⏎$ python3 app.py⏎84⏎21⏎<|bos|>One day, a
-
story 4.96⏎$ python3 test_lib.py⏎all tests passed⏎<|bos|>Once upon a time
-
chat 4.94$ python3 script.py⏎6⏎banana cloud⏎n⏎<|bos|><|user_start|>Who won the
-
story 4.91⏎$ python3 hello.py⏎cloud⏎star⏎5⏎<|bos|>Once upon a time
-
agent 4.9⏎$ python3 test_lists.py⏎all tests passed⏎<|bos|><|system_start|>tools: edit
-
agent 4.9)⏎⏎$ python3 demo.py⏎6⏎9⏎<|bos|><|system_start|>tools: edit