pancake :radare2: on Nostr: For some reason people tend to think LLM require heavy hardware requirements and you ...
For some reason people tend to think LLM require heavy hardware requirements and you can’t make them run locally in your phone. You will be surprised to know that your iPhone have better graphics card, owns a neural processor and 8GB of ram is more than enough to get 20tokens/s
Published at
2025-01-30 09:02:28 UTCEvent JSON
{
"id": "742e09a7190f93896272a51147d8616aca847ef5741765dd73cc78356aa1f4a2",
"pubkey": "782ac43e4d54563caed6f79961edf5443f6f264a5095d77e1b95009f5248c0ac",
"created_at": 1738227748,
"kind": 1,
"tags": [
[
"proxy",
"https://infosec.exchange/users/pancake/statuses/113916493711104496",
"activitypub"
]
],
"content": "For some reason people tend to think LLM require heavy hardware requirements and you can’t make them run locally in your phone. You will be surprised to know that your iPhone have better graphics card, owns a neural processor and 8GB of ram is more than enough to get 20tokens/s",
"sig": "a7812342712a4e1b7cf76cc892e0c747743e086387ee6298beda9336e321f411f37d0632f89f6ad6e98c330eb4ddf22f83ab0ffa111f2eb9b28c95a0aa423ff6"
}
