This company is doing some unique quantization. They got the Qwen 27B down to six gigabytes. They are on Hugging Face.
https://prismml.com/news/bonsai-27b
David Bucienski
npub123…579w6
2026-07-20 12:10:35 UTC
in reply to nevent1q…4ljw
Author Public Key
npub123t95x6c537zd5tvw6p7lfnd6p7uhwnrnxsxz20u86rzccvrd83s2579w6Seen on
wss://relay.momostr.pinkPublished at
2026-07-20 12:10:35 UTCEvent JSON
{
"id": "a054a9ab2ca41b2a127b44b1718cd6d24f6f93d8b19c4e8fa3967a3db5e0a892",
"pubkey": "54565a1b58a47c26d16c7683efa66dd07dcbba6399a06129fc3e862c618369e3",
"created_at": 1784549435,
"kind": 1,
"tags": [
[
"p",
"4194804161bbde4a6848cc2f7de4ed22eb6b55685bda4081b6a940e1f5968fa5"
],
[
"p",
"134923ad77a79e45dddf47a4ce8b36e1fc1270f0df735f34056598759a5c8bd6"
],
[
"e",
"3ab9877fca090d803285489eb5e206952d5a47807809b02f7cce665a47b22d52",
"",
"root",
"4194804161bbde4a6848cc2f7de4ed22eb6b55685bda4081b6a940e1f5968fa5"
],
[
"e",
"0f4e3e0cc17208acbc534183cc2425fe0692ed37eb29d2832f03c16a05f00349",
"",
"reply",
"134923ad77a79e45dddf47a4ce8b36e1fc1270f0df735f34056598759a5c8bd6"
],
[
"proxy",
"https://noauthority.social/@DavidB/116952231822573765",
"web"
],
[
"proxy",
"https://noauthority.social/users/DavidB/statuses/116952231822573765",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://noauthority.social/users/DavidB/statuses/116952231822573765",
"pink.momostr"
],
[
"-"
]
],
"content": "This company is doing some unique quantization. They got the Qwen 27B down to six gigabytes. They are on Hugging Face. \n\nhttps://prismml.com/news/bonsai-27b",
"sig": "a9ef20ab95303efb3c82b2cded54ac6459213350f491412c5c0f38717f42adfd89aad9fd503e0b04ed12fd31eb80abc21e70646c1651901bb19d02f84af2d63e"
}