Skip to content
mini-lab
Log in Sign up
Features of prelude-2

Feature #304

Fires on “ return” (not labeled yet: read the examples)

Fires on
0.52% of tokens
Mostly in
python
Layer
after block 4

Where it fires

  • python 62%
  • agent 31%
  • story 6%
  • chat 2%
  • worksheet 0%

Makes the model say

( around /replaceAll⏎ meanh average

Makes it not say

⏎ live<|bos|> lived many bigfactorial be

Strongest examples

On text the dictionary never trained on. The underlined token is where it fires most.

  1. python 4.14
    .⏎⏎```python⏎def mean_list(nums):⏎ return sum(nums)
  2. python 4.14
    .⏎⏎```python⏎def mean_list(nums):⏎ return sum(nums)
  3. agent 4.0
    utils.py<|arg|>content=def mean_list(nums):⏎ return sum(nums)
  4. python 3.96
    8⏎<|bos|>```python⏎def mean_list(nums):⏎ return sum(nums)
  5. python 3.92
    `.⏎⏎```python⏎def mean_list(nums):⏎ return sum(nums)
  6. python 3.92
    .⏎⏎```python⏎def average_list(nums):⏎ return sum(nums)
  7. python 3.81
    True⏎⏎```python⏎def mean_list(nums):⏎ return sum(nums)
  8. python 3.76
    )`.⏎⏎```python⏎def mean_list(nums):⏎ return sum(nums)
  9. python 3.73
    .⏎⏎```python⏎def mean_list(nums):⏎ return sum(nums)
  10. python 3.72
    )`.⏎⏎```python⏎def mean_list(nums):⏎ return sum(nums)
  11. python 3.69
    ⏎# stats.py⏎def mean_list(nums):⏎ return sum(nums)
  12. agent 3.68
    n in nums]⏎⏎⏎def mean_list(nums):⏎ return sum(nums)