Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #157

Fires on “ an” (not labeled yet: read the examples)

Fires on
0.71% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 53%
  • chat 31%
  • worksheet 11%
  • story 4%
  • python 2%

Makes the model say

6 named⏎⏎ who31'm2

Makes it not say

heoldStringhedise FilenewString % love

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 1.91
    is the Eiffel Tower?<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I
  2. story 1.89
    loved her toy key. She took it everywhere she went. Mia was an independent girl who liked
  3. worksheet 1.85
    +8: 4+8=12, 12⏎So
  4. chat 1.83
    <|user_start|>What does DNA stand for?<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I
  5. chat 1.82
    I fix a flat tire?<|user_end|><|assistant_start|>Sorry, I'm a tiny model: I
  6. agent 1.77
    search, write, execute<|system_end|><|system_start|>You are an AI agent running in
  7. agent 1.77
    search, write, execute<|system_end|><|system_start|>You are an AI agent running in
  8. agent 1.77
    search, write, execute<|system_end|><|system_start|>You are an AI agent running in
  9. agent 1.76
    search, write, execute<|system_end|><|system_start|>You are an AI agent running in
  10. agent 1.76
    search, write, execute<|system_end|><|system_start|>You are an AI agent running in
  11. agent 1.75
    search, write, execute<|system_end|><|system_start|>You are an AI agent running in
  12. agent 1.74
    search, write, execute<|system_end|><|system_start|>You are an AI agent running in