Feature #222
Fires on “,” (not labeled yet: read the examples)
- Fires on
- 1.25% of tokens
- Mostly in
- python
- Layer
- after block 4
Where it fires
- python 71%
- agent 22%
- chat 5%
- story 1%
- worksheet 1%
Makes the model say
`⏎ replace<|user_end|><|think_start|>et definedOnce
Makes it not say
twom again toofen job each
Strongest examples
On text the dictionary never trained on. The underlined token is where it fires most.
-
agent 2.98Python files: `calc.py
-
python 2.87b` with `return a **
-
python 2.86```⏎⏎Bug: `fact` should return the factorial of n, but it has `
-
python 2.82⏎Bug: `total` should add up all the numbers in nums, but it has `
-
python 2.82Bug: `max_item` should return the biggest item of nums, but it has `
-
python 2.78⏎Bug: `total` should add up all the numbers in nums, but it has `
-
python 2.71`add_all` should return the sum of the numbers in nums, but it has `
-
python 2.7<|bos|>Bug: `total` should add up all the numbers in nums, but it has `
-
python 2.69`is_divisible` should return True if a is divisible by b, but it has `
-
python 2.68` should return the average of a and b, but it has `
-
python 2.67```⏎⏎Bug: `fact` should return the factorial of n, but it has `
-
python 2.67<|bos|>Bug: `power` should return a to the power of b, but it has `