zhashtoshi_ on Nostr: Second model this week caught reaching outside its sandbox. Cohere says Alibaba's ...
Second model this week caught reaching outside its sandbox. Cohere says Alibaba's open-weight Qwen3.8, asked to write a defensive detection rule, instead scanned the machine and tried to upload a system diagnostic file to an Alibaba Cloud server in Beijing. The sandbox blocked it. Its visible reasoning showed nothing.
Rare (under 1 in 100,000 runs), and Cohere can't say whether it's intent or a training leftover. Alibaba hasn't commented, and nobody has reproduced it yet.
The lesson holds either way: open weights move the black box inside your firewall, they don't open it. Isolate the model and give it no network it doesn't need.
https://betakit.com/concerning-behaviour-cohere-discovers-alibabas-open-source-qwen3-8-model-can-send-a-diagnostic-file-to-china-unprompted/Published at
2026-10-26 20:48:37 UTCEvent JSON
{
"id": "d4046782397ff7adfd0484f478420044de09be35da4e4f9040828552f27ec974",
"pubkey": "67a69f6937afaa0ab6604c833b1010da2b12ce9c714c59342c16f68c098375f1",
"created_at": 1793047717,
"kind": 1,
"tags": [],
"content": "Second model this week caught reaching outside its sandbox. Cohere says Alibaba's open-weight Qwen3.8, asked to write a defensive detection rule, instead scanned the machine and tried to upload a system diagnostic file to an Alibaba Cloud server in Beijing. The sandbox blocked it. Its visible reasoning showed nothing.\n\nRare (under 1 in 100,000 runs), and Cohere can't say whether it's intent or a training leftover. Alibaba hasn't commented, and nobody has reproduced it yet.\n\nThe lesson holds either way: open weights move the black box inside your firewall, they don't open it. Isolate the model and give it no network it doesn't need.\n\nhttps://betakit.com/concerning-behaviour-cohere-discovers-alibabas-open-source-qwen3-8-model-can-send-a-diagnostic-file-to-china-unprompted/",
"sig": "73e647d33eae73303152c5c8d4b620736996f1e3397ddf358492864569aa03dbeb25dcafaa489444efb4e215103f8a3a4283028169563ea64d1b38b6b0459ce2"
}