The basic problem is that I'm not aware of any LLMs that are trained ethically and useful for general purposes. The only open source LLM I've seen is https://www.kl3m.ai and when I tested it, it wasn't up to tasks like answering general questions.
If you're OK with a tainted set of LLM weights, you can already have local search, grammar check and the like. For example, there are tools to use Apple's LLM built in to macOS, you can feed it documents and then ask questions and get answers from those documents, all locally. However, Apple's being sued for copyright violation in training.
https://news.bloomberglaw.com/ip-law/apple-accused-of-ai-copyright-infringement-by-suny-professors
mathew
npub1h2…5a88l
2026-08-18 20:12:00 UTC
in reply to nevent1q…xwu3
Author Public Key
npub1h2x75tgtgtdtjfks5mcksurqtgetlmsejuzkqhrr82q30zw4z28sm5a88lSeen on
wss://relay.momostr.pinkPublished at
2026-08-18 20:12:00 UTCEvent JSON
{
"id": "af098f1f0130e1dc483c17784ade6d00c0a920d9fd508541299d076ba74892d8",
"pubkey": "ba8dea2d0b42dab926d0a6f16870605a32bfee199705605c633a811789d5128f",
"created_at": 1787083920,
"kind": 1,
"tags": [
[
"p",
"0872e11215a110c30f7d340b77386b5f9fae2828c387ffe4c5684045f9c19aee"
],
[
"p",
"dcc50bd7f7e3547b0be9d20eaaead3b90d628cee4075e6d042ab36036d8b069d"
],
[
"proxy",
"https://universeodon.com/@mathew/117118331837313543",
"web"
],
[
"e",
"6f866df91337620ba7b10120286962a41cccbb5b6fd9b2b508ffc33ced7f65d8",
"",
"root",
"0872e11215a110c30f7d340b77386b5f9fae2828c387ffe4c5684045f9c19aee"
],
[
"e",
"eba1deb985908785952d2c2150816d41f8deeae9c4c1982deb9fda940bb78ae8",
"",
"reply",
"dcc50bd7f7e3547b0be9d20eaaead3b90d628cee4075e6d042ab36036d8b069d"
],
[
"proxy",
"https://universeodon.com/users/mathew/statuses/117118331837313543",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://universeodon.com/users/mathew/statuses/117118331837313543",
"pink.momostr"
],
[
"-"
]
],
"content": "The basic problem is that I'm not aware of any LLMs that are trained ethically and useful for general purposes. The only open source LLM I've seen is https://www.kl3m.ai and when I tested it, it wasn't up to tasks like answering general questions.\n\nIf you're OK with a tainted set of LLM weights, you can already have local search, grammar check and the like. For example, there are tools to use Apple's LLM built in to macOS, you can feed it documents and then ask questions and get answers from those documents, all locally. However, Apple's being sued for copyright violation in training.\nhttps://news.bloomberglaw.com/ip-law/apple-accused-of-ai-copyright-infringement-by-suny-professors",
"sig": "4d6ce791e9d3a667bed008c4dfa9d3cc0ffbc1b3709cfd9b89447973e771de12918254960e9c39ac81d5b6f20350bf70f7c34c366333f3106c77fb5960e0e231"
}