Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #1671

Fires on “ time” (not labeled yet: read the examples)

Fires on
0.66% of tokens
Mostly in
story
Layer
after block 4

Where it fires

  • story 53%
  • chat 33%
  • worksheet 9%
  • agent 2%
  • python 2%

Makes the model say

went Tom now = overfe int

Makes it not say

``` matterverapp she<|think_end|> subtractri

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. story 4.31
    <|bos|>Once upon a time, there was a
  2. story 4.31
    <|bos|>Once upon a time, there was a
  3. story 4.31
    <|bos|>Once upon a time, there was a
  4. story 4.31
    <|bos|>Once upon a time, there was a
  5. story 4.31
    <|bos|>Once upon a time, in a big
  6. story 4.31
    <|bos|>Once upon a time, there was a
  7. story 4.02
    ```<|assistant_end|><|bos|>Once upon a time, there was a
  8. story 3.92
    1382<|bos|>Once upon a time, there was an
  9. story 3.91
    <|assistant_end|><|bos|>Once upon a time, there was a
  10. story 3.86
    to show everyone back home!<|bos|>Once upon a time, in a small
  11. story 3.84
    495<|assistant_end|><|bos|>Once upon a time, in a small
  12. story 3.83
    together.<|bos|>Once upon a time there was a gray