Skip to content
mini-lab
Features of prelude-2

Feature #1702

Fires on “#” (not labeled yet: read the examples)

Fires on
0.41% of tokens
Mostly in
chat
Layer
after block 4

Where it fires

  • chat 42%
  • python 19%
  • story 17%
  • worksheet 16%
  • agent 6%

Makes the model say

re0th," turn sat1av

Makes it not say

trouble around away ==pydy⏎ replaceAll

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 4.95
    is 1248.<|assistant_end|><|bos|># README.md⏎# Toolbox⏎
  2. python 4.91
    ⏎print(tail(SCORES))⏎⏎# README.md⏎# Word tools⏎
  3. python 4.87
    b):⏎ return a * b⏎⏎# README.md⏎# Calculator⏎⏎
  4. python 4.81
    n):⏎ return s * n⏎⏎# README.md⏎# Demo⏎⏎
  5. python 4.8
    = 104261<|bos|># README.md⏎# Playground
  6. python 4.8
    The answer is 79.<|assistant_end|><|bos|># README.md⏎# Playground
  7. python 4.78
    ⏎print(size("cloud"))⏎⏎# README.md⏎# Tiny utils⏎⏎
  8. python 4.77
    , 8, 1]))⏎⏎# README.md⏎# Toolbox⏎
  9. python 4.76
    The answer is 93.<|assistant_end|><|bos|># README.md⏎# Scratch⏎
  10. python 4.73
    2 for n in nums]⏎⏎# README.md⏎# Scratch⏎
  11. python 4.72
    ⏎print("all tests passed")⏎⏎# README.md⏎# Toolbox⏎
  12. python 4.71
    print(magnitude(6))⏎⏎# README.md⏎# Toolbox⏎