Skip to content
mini-lab
Features of prelude-2

Feature #3572

Fires on “ belonged” (not labeled yet: read the examples)

Fires on
0.44% of tokens
Mostly in
agent
Layer
after block 4

Where it fires

  • agent 76%
  • story 15%
  • chat 3%
  • worksheet 3%
  • python 2%

Makes the model say

utils forever everwhere always x positive everywhere

Makes it not say

` Sue There Bie asked breath they

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 2.41
    , someone lost their passport. We need to find who it belongs to."⏎
  2. chat 2.21
    They asked everyone in the park, but no one knew who the cake belonged to. Then,
  3. story 2.19
    The spoon had a big family, but it did not feel like it belonged. The spoon was
  4. story 2.15
    knew who it belonged to. They were
  5. story 2.04
    eat it?"⏎"I don't know, Lily. Maybe it belongs to someone.
  6. story 1.92
    playing with it.⏎But soon, he realised that the face belonged to a big bird
  7. story 1.89
    They said, "Yes, please. That is our kite. It belongs to us.
  8. agent 1.87
    (decrrement(6))<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=run.py
  9. story 1.86
    . From that day on, Max never took things that did not belong to him.<|bos|><|system_start|>
  10. story 1.85
    , "Yuck! This sock is smelly! Who does it belong to?" Sam didn
  11. agent 1.85
    opposte(8))<|tool_end|><|assistant_start|><|tool_call_start|>edit<|arg|>path=hello.py
  12. story 1.82
    Tim and Sam listened to their mom. They found out the smelly sock belonged to Sam. They