Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #2291

Fires on “ recent” (not labeled yet: read the examples)

Fires on
0.85% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 49%
  • agent 19%
  • python 13%
  • chat 12%
  • worksheet 7%

Makes the model say

like liked wanted strong walking sailse tall

Makes it not say

<|think_end|>oldString{command code voicepypo

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.21
    there was a mighty big farm. On this farm, there were many animals who liked to play
  2. agent 2.17
    Traceback (most recent call last):⏎
  3. story 2.15
    The tree was in a big forest. The forest had many trees and animals. Tim loved to
  4. story 2.1
    the snow all day.<|bos|>Once upon a time, there were two friends called Ant and
  5. agent 2.1
    (most recent call last):⏎
  6. agent 2.1
    (most recent call last):⏎
  7. agent 2.1
    (most recent call last):⏎
  8. story 2.1
    `.⏎<|bos|>Once upon a time, in a beautiful land, there were many colors. The
  9. story 2.05
    a time, there was a colorful farm. On this farm, there were many animals. The
  10. story 2.04
    and add numbers.<|assistant_end|><|bos|>Once upon a time, there were two friends called Drew and
  11. story 2.04
    The next day, the
  12. chat 2.04
    The answer is 8