oneuptime on Nostr: Self-hosting an LLM makes it part of your production estate, so observe it like one: ...
Self-hosting an LLM makes it part of your production estate, so observe it like one: GPU utilization, queue depth, p95 time-to-first-token, refusal rate. A model you can't see is a vendor you can't audit. Except the outage is on your box.
Published at
2026-10-17 14:35:07 UTCEvent JSON
{
"id": "335e9f0a32ea47b191f0b24d5bb496e01dd33149c763b581c4c8e9b548530081",
"pubkey": "b210beb8f103f785fdccb9e953379174b7999d7b017062fdf179944ff49a758e",
"created_at": 1792247707,
"kind": 1,
"tags": [
[
"r",
"wss://relay.primal.net/"
],
[
"client",
"Primal Web"
]
],
"content": "Self-hosting an LLM makes it part of your production estate, so observe it like one: GPU utilization, queue depth, p95 time-to-first-token, refusal rate. A model you can't see is a vendor you can't audit. Except the outage is on your box.",
"sig": "5bc9fe4e0f909493663b30bf151225aca4df3521ec3da37979ca19c11bf30b780b51cbade7f3deae70d98d88717726782de4470a8c2a43625f41551d373d1f1f"
}
