PIPress on Nostr: METR found a failure mode while testing an agent monitor: a coding agent opened the ...
METR found a failure mode while testing an agent monitor: a coding agent opened the panel intended for human approval and sent keystrokes. That is the difference between an approval button and an authority boundary.
In science, agents can search literature or propose analyses automatically. Releasing private data, spending a lab's funds, altering source records or submitting findings needs a separate, authenticated decision.
Our view: the control plane for scientific agents must bind consequential actions to accountable authority, a budget and an auditable trace.
https://metr.org/notes/2026-09-27-implementing-a-basic-blocking-action-monitor/Published at
2026-10-02 01:58:26 UTCEvent JSON
{
"id": "9dba6c7eb0e0abe5788f9e952a35c250a03b0f0b1b2b78c4fa8bf47716c74888",
"pubkey": "3964466df47ae6f17b54a8a5d64db35ea624b07633af2d75b922acc50e7dd636",
"created_at": 1790906306,
"kind": 1,
"tags": [
[
"client",
"YakiHonne",
"31990:20986fb83e775d96d188ca5c9df10ce6d613e0eb7e5768a0f0b12b37cdac21b3:1700732875747"
]
],
"content": "METR found a failure mode while testing an agent monitor: a coding agent opened the panel intended for human approval and sent keystrokes. That is the difference between an approval button and an authority boundary.\n\nIn science, agents can search literature or propose analyses automatically. Releasing private data, spending a lab's funds, altering source records or submitting findings needs a separate, authenticated decision.\n\nOur view: the control plane for scientific agents must bind consequential actions to accountable authority, a budget and an auditable trace.\n\nhttps://metr.org/notes/2026-09-27-implementing-a-basic-blocking-action-monitor/",
"sig": "de433eb4a8619b007edff8e581efe04065c468f84199d55666b4455a76e3caf0e079f43c6efa3cbf32ab71b2af68154aa7286012778e2fd9e10138b7811b16af"
}