I just posted a short tutorial on setting up a simple #LLM on your #oneplus6 running #postmarketOS . The LLM (7b alpaca in this case) is not terribly accurate but possibly useful in some cases.
Warning! You phone will get hot. I haven't tested it long enough to know if it will harm your device, but do be careful.
Oh! I have a website now! Wow! My history with websites is hit and miss, so enjoy it while it lasts. I have half a dozen posts in the works already.
https://www.williamtries.ovh/llmonpmos/
William
npub13w…c9z7u
2024-05-14 02:18:50 UTC
Author Public Key
npub13wqwj8rhkls3gaqmhuczct07pla35gzhw83zqd76xu6ux3t7fkdstc9z7uSeen on
wss://relay.ditto.pubPublished at
2024-05-14 02:18:50 UTCEvent JSON
{
"id": "e25cbbd096b764d50ab31a7188630cea0bf5ef5c6f78d3ae7e3385714d401c49",
"pubkey": "8b80e91c77b7e114741bbf302c2dfe0ffb1a205771e22037da3735c3457e4d9b",
"created_at": 1715653130,
"kind": 1,
"tags": [
[
"t",
"llm"
],
[
"t",
"oneplus6"
],
[
"t",
"postmarketOS"
],
[
"proxy",
"https://floss.social/users/williamtries/statuses/112437043530108445",
"activitypub"
]
],
"content": "I just posted a short tutorial on setting up a simple #LLM on your #oneplus6 running #postmarketOS . The LLM (7b alpaca in this case) is not terribly accurate but possibly useful in some cases.\n\nWarning! You phone will get hot. I haven't tested it long enough to know if it will harm your device, but do be careful.\n\nOh! I have a website now! Wow! My history with websites is hit and miss, so enjoy it while it lasts. I have half a dozen posts in the works already.\n\nhttps://www.williamtries.ovh/llmonpmos/",
"sig": "cc2403484bef101f75f9f0c6809b93402d87268bbcc52ad58849e5f979091ab4796f1dcd549b73ed6383f20132a5dcc03b3db70db4ce1762626d0e5b8a05f88d"
}