there is the basic problem that LLM are by definition a big tech technology. It's ludicrously expensive to train models from the ground up and requires incredible amounts of data that is hard to come by unless you disregard all copyright.
That's why the majority of "open weight" models are just modified versions of open weight models originating from big tech companies.
Sheogorath
npub1fr…a5a27
2026-03-01 09:54:03 UTC
in reply to nevent1q…6xxy
Author Public Key
npub1frkedgrjevuxctmsfkh2c8f2rmfq8mjk9rlufuvr9ujrwwdcd48sva5a27Seen on
wss://relay.momostr.pinkPublished at
2026-03-01 09:54:03 UTCEvent JSON
{
"id": "68a5023541bb162b824f3c22ed63d118f1c95d7f8276b65aaa3368baea6decf7",
"pubkey": "48ed96a072cb386c2f704daeac1d2a1ed203ee5628ffc4f1832f243739b86d4f",
"created_at": 1772358843,
"kind": 1,
"tags": [
[
"e",
"1e070e5673d4b8856cfc462dd4c3079904e0bf3780ae69b1e4fc2b0395c31bd6",
"",
"root",
"62b4002513dcb7efac1dec876f9c066d7aea38e9f6651978f7c013a7dfac23f6"
],
[
"p",
"62b4002513dcb7efac1dec876f9c066d7aea38e9f6651978f7c013a7dfac23f6"
],
[
"proxy",
"https://microblog.shivering-isles.com/@sheogorath/116153309179681994",
"web"
],
[
"p",
"7298b641d0a988e99a747886b5e2c09e291cf19460179b5f292f29db5f9542db"
],
[
"proxy",
"https://microblog.shivering-isles.com/users/sheogorath/statuses/116153309179681994",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://microblog.shivering-isles.com/users/sheogorath/statuses/116153309179681994",
"pink.momostr"
],
[
"-"
]
],
"content": "there is the basic problem that LLM are by definition a big tech technology. It's ludicrously expensive to train models from the ground up and requires incredible amounts of data that is hard to come by unless you disregard all copyright.\n\nThat's why the majority of \"open weight\" models are just modified versions of open weight models originating from big tech companies.",
"sig": "653a4dc251309262d8b9a48455b3fb53b7b61dc48880a4cdcef6f096f8ed60b8de5829e936e405b2b0bc809d9d2f37735dc6dc7da2eca9b7acb94ebd318241a3"
}