Skip to content
mini-lab
Features of prelude-2

Feature #944

Fires on “#” (not labeled yet: read the examples)

Fires on
0.33% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 47%
  • story 25%
  • python 21%
  • chat 6%
  • worksheet 1%

Makes the model say

over<|think_end|>ning nextreplaceAll thenThat import

Makes it not say

could`?",print she]) but

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 5.51
    print(magnitude(6))⏎⏎# README.md⏎# Toolbox⏎
  2. python 5.48
    ⏎print(size("cloud"))⏎⏎# README.md⏎# Tiny utils⏎⏎
  3. python 5.45
    ⏎print("all tests passed")⏎⏎# README.md⏎# Calculator⏎⏎
  4. python 5.45
    ⏎print(tail(SCORES))⏎⏎# README.md⏎# Word tools⏎
  5. python 5.38
    2 for n in nums]⏎⏎# README.md⏎# Scratch⏎
  6. python 5.34
    ⏎print("all tests passed")⏎⏎# README.md⏎# Word tools⏎
  7. python 5.34
    ⏎print(fact(5))⏎⏎# README.md⏎# Playground
  8. python 5.33
    is 1248.<|assistant_end|><|bos|># README.md⏎# Toolbox⏎
  9. python 5.33
    ⏎print("all tests passed")⏎⏎# README.md⏎# Scratch⏎
  10. python 5.31
    , 2], 8))⏎⏎# README.md⏎# Demo⏎⏎
  11. python 5.3
    ⏎print("all tests passed")⏎⏎# README.md⏎# My project⏎⏎
  12. python 5.28
    , 8, 1]))⏎⏎# README.md⏎# Toolbox⏎