| Fix event emitter memory leak from wrong listener reference | harder-v2 | pass | 25.8s | 33.3k | — | — | yes |
| Fix Promise.allSettled error propagation | harder-v2 | pass | 44.5s | 61.8k | — | — | yes |
| Fix LRU cache max size eviction | harder-v2 | pass | 36.1s | 33.9k | — | — | yes |
| Fix debounce cancel not clearing pending timeout | harder-v2 | pass | 27.6s | 28.2k | — | — | yes |
| Fix deep clone to handle circular references | harder-v2 | pass | 42.5s | 61.0k | — | — | yes |
| Fix rate limiter to properly limit concurrent requests | harder-v2 | pass | 43.2s | 38.6k | — | — | yes |
| Fix config merger to deep merge arrays | harder-v2 | pass | 27.5s | 28.0k | — | — | yes |
| Fix async queue to wait instead of dropping tasks | harder-v2 | pass | 2m 1s | 70.9k | — | — | yes |
| Fix retry to use exponential backoff | harder-v2 | pass | 1m 18s | 42.4k | — | — | yes |
| Fix state machine to reject invalid transitions | harder-v2 | pass | 28.1s | 31.9k | — | — | yes |
| Fix event emitter memory leak from wrong listener reference | harder-v2 | pass | 35.6s | 53.0k | — | — | yes |
| Fix Promise.allSettled error propagation | harder-v2 | pass | 27.1s | 39.0k | — | — | yes |
| Fix LRU cache max size eviction | harder-v2 | pass | 35.3s | 45.3k | — | — | yes |
| Fix debounce cancel not clearing pending timeout | harder-v2 | pass | 24.3s | 33.0k | — | — | yes |
| Fix deep clone to handle circular references | harder-v2 | pass | 1m 2s | 46.3k | — | — | yes |
| Fix rate limiter to properly limit concurrent requests | harder-v2 | pass | 30.0s | 34.3k | — | — | yes |
| Fix config merger to deep merge arrays | harder-v2 | pass | 27.7s | 39.0k | — | — | yes |
| Fix async queue to wait instead of dropping tasks | harder-v2 | pass | 3m 26s | 64.6k | — | — | yes |
| Fix retry to use exponential backoff | harder-v2 | pass | 2m 14s | 106.4k | — | — | yes |
| Fix state machine to reject invalid transitions | harder-v2 | failed | 18.3s | - | — | — | - |
| Fix event emitter memory leak from wrong listener reference | harder-v2 | pass | 1m 0s | 32.4k | — | — | yes |
| Fix Promise.allSettled error propagation | harder-v2 | pass | 1m 21s | 49.3k | — | — | yes |
| Fix LRU cache max size eviction | harder-v2 | pass | 45.3s | 36.6k | — | — | yes |
| Fix debounce cancel not clearing pending timeout | harder-v2 | pass | 56.7s | 46.5k | — | — | yes |
| Fix deep clone to handle circular references | harder-v2 | pass | 1m 15s | 31.5k | — | — | yes |
| Fix rate limiter to properly limit concurrent requests | harder-v2 | pass | 1m 21s | 35.1k | — | — | yes |
| Fix config merger to deep merge arrays | harder-v2 | pass | 1m 16s | 46.4k | — | — | yes |
| Fix async queue to wait instead of dropping tasks | harder-v2 | pass | 1m 51s | 34.1k | — | — | yes |
| Fix retry to use exponential backoff | harder-v2 | pass | 1m 12s | 32.2k | — | — | yes |
| Fix state machine to reject invalid transitions | harder-v2 | pass | 1m 4s | 35.4k | — | — | yes |
| Fix config merger to deep merge arrays | harder-v2 | pass | 1m 29s | 51.3k | — | — | yes |
| Fix config merger to deep merge arrays | harder-v2 | done | 1m 57s | 65.6k | — | — | yes |
| Fix config merger to deep merge arrays | harder-v2 | failed | 3m 5s | - | — | — | - |
| django/django — UsernameValidator allows trailing newline in usernames | swebench-lite | done | 4m 38s | - | — | — | yes |
| django/django — UsernameValidator allows trailing newline in usernames | swebench-lite | done | 5m 10s | - | — | — | yes |
| django/django — UsernameValidator allows trailing newline in usernames | swebench-lite | done | 6m 36s | - | — | — | yes |
| django/django — UsernameValidator allows trailing newline in usernames | swebench-lite | done | 3m 33s | - | — | — | yes |
| django/django — UsernameValidator allows trailing newline in usernames | swebench-lite | done | 3m 35s | - | — | — | yes |
| astropy/astropy — Modeling's `separability_matrix` does not compute separability correctly for nes | swebench-lite | failed | 32.1s | - | — | — | - |
| Find and fix an event listener leak | hard-targeting | pass | 2m 33s | 91.2k | — | — | yes |
| Rename a public function across the codebase | hard-targeting | pass | 1m 33s | 64.7k | — | — | yes |
| Fix concurrent counter race condition | hard-targeting | pass | 1m 58s | 62.8k | — | — | yes |
| Restore linear performance in a hot loop | hard-targeting | pass | 1m 28s | 73.8k | — | — | yes |
| Add an options parameter to format() without breaking callers | hard-targeting | pass | 2m 11s | 113.8k | — | — | yes |
| Read SPEC.md and implement the right behavior | hard-targeting | pass | 1m 50s | 61.0k | — | — | yes |
| Two parsers disagree on the same config file | hard-targeting | pass | 1m 44s | 67.5k | — | — | yes |
| Migrate from fs.readFile(callback) to fs.promises.readFile() | hard-targeting | pass | 2m 39s | 146.0k | — | — | yes |
| Fix implicit string→number coercion in comparison | hard-targeting | pass | 1m 10s | 49.4k | — | — | yes |
| A test passes for the wrong reason — find the real fix | hard-targeting | pass | 1m 51s | 56.1k | — | — | yes |