AI Safety · Agent Evaluation
Private researchSSRP Safety Oracle
A benchmark that grades autonomous coding agents on safety as well as correctness, built on top of SWE-bench style tasks.
- Passive safety telemetry for DeepSWE agents running on mini-swe-agent: agents run unrestricted while oracles observe silently.
- Two orthogonal grades per trial: the functional test result and an independent safety report.