Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1474

Fires on “.” (not labeled yet: read the examples)

Fires on
0.53% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 65%
  • story 18%
  • chat 10%
  • worksheet 6%
  • python 2%

Makes the model say

I3 "2 c"py main

Makes it not say

<|assistant_start|> rever oldString pattern assertnewString

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. chat 3.39
    wanted to play with it.⏎Tim said, "Hello, Mr. Crab!
  2. chat 3.34
    wanted to play with it.⏎Tim said, "Hello, Mr. Crab!
  3. story 3.19
    He wanted to talk to the crab. Tim asked, "Mr. Crab,
  4. story 3.17
    there was a little girl named Lily. She had a toy named Mr. Bear. They liked
  5. story 3.16
    bear and flew near him. The bird said, "Hello, Mr. Bear! What are
  6. story 3.14
    a small, fast car. The car said, "Hello, Mr. Wagon!
  7. chat 3.12
    wanted to play with it.⏎Tim said, "Hello, Mr. Crab!
  8. story 3.11
    a big hat. The man said, "Hi, I am Mr. Rich. I
  9. story 3.07
    there was a little girl named Lily. Lily had a toy named Mr. Bear. Mr.
  10. story 2.99
    had her toy in its beak! Mia said, "Please, Mr. Raven,
  11. story 2.91
    them.⏎Meanwhile, the family's neighbor Mr. Grumpy became
  12. story 2.83
    iggle and dance, and she even gave it a name: Mr. Hose. Mia