Skip to content
mini-lab
Features of prelude-2

Feature #1285

Fires on “ that” (not labeled yet: read the examples)

Fires on
0.28% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 52%
  • story 42%
  • chat 4%
  • python 2%
  • worksheet 0%

Makes the model say

bcep<|arg|>This largest rest

Makes it not say

returnone<|tool_call_end|>number (# +[::-

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.61
    . Bob was happy, and the squirrel felt better. They both learned that when you panic
  2. chat 4.55
    , Sam caught him. They both laughed and had fun. Ben learned that he could trust his
  3. story 4.49
    and ran away. Ben and Tom were happy and safe. They learned that sometimes, something scary
  4. story 4.47
    !" Tim felt happy that he had finished the job, and he learned that it is important to
  5. story 4.25
    fish were happy. They thanked Fin for helping them. Fin learned that being different was not
  6. story 4.2
    the trap, and Jerry was safe.⏎Tom and Jerry learned that being smart is more
  7. story 4.11
    toy stopped growing, and Sue and Tim learned that sharing with others can
  8. chat 4.08
    , Sam caught him. They both laughed and had fun. Ben learned that he could trust his
  9. story 4.02
    nosy little friend. They played together all day long, and Tom learned that even small cats can
  10. story 4.01
    milk.⏎They both drank the milk and felt happy. They learned that working together made things
  11. story 3.99
    Tom learned that sometimes, even when
  12. chat 3.93
    toys back to the sad animals. They were happy again! Kitty learned that taking things from others