Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #990

Fires on “ be” (not labeled yet: read the examples)

Fires on
0.06% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 46%
  • agent 34%
  • story 16%
  • chat 2%
  • worksheet 1%

Makes the model say

treatwhere And<|tool_call_start|>defas explorecked

Makes it not say

, how( became need turned fast many

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 1.52
    beat the cream.
  2. agent 1.52
    be `reverse`. It
  3. story 1.52
    be doing a great job
  4. agent 1.52
    be `positive`. It
  5. story 1.52
    be fixed." The poor
  6. story 1.52
    be clean, so he
  7. story 1.26
    more careful when he went on his adventures, helping him to prevent further danger.
  8. story 1.25
    knife and put it in her bag to keep everyone safe. Lily felt
  9. story 1.23
    keeps beeping. Tom
  10. story 1.2
    sign that said "Welcome!" There was a big party with all their friends. Tim was
  11. chat 1.19
    his mom. Now, Tim knew he could be brave and help keep everyone safe.<|assistant_end|><|bos|>
  12. story 1.17
    ious too. But then, both dogs became friends and played together with their toys. And they