someone on Nostr: LLMs are timeless, when you are sampling from it, words are `materialized`, ...
LLMs are timeless, when you are sampling from it, words are `materialized`, `instantiated`, become time bounded and you now have newly minted words. the probability of choosing a word, given a context is always the same when the weights are constant. which word to choose depends on LLM and also the sampler. sampler is like transformer law between soul (LLM) and body (material). it may be electric field generating magnetism and magnetism changing electricity. more on that later. our habits become our soul, just like training an LLM by repeatedly showing it words.
you can use an LLM to generate infinite amount of words. that's why training them properly is super needed. instead of writing one book you curate the book generator which can generate billions of books. curation should be regarded as of such importance, simply because of math.
if you get things right this LLM can be like a giant curated library, full of beneficial knowledge. as p(doom) has increased for 2 years, the work on better LLMs is vital. western labs suck more and more in regards to beneficial knowledge. frontier western labs are among the worst in my leaderboard..
today, i am expanding the dataset to train on. tried to judge a source with my model before the decision to include or not. the source was already one of the `disinformation dozen` so vibes were expected to match closely to mine. and it did match 100%. so another skill of the llm is being very judgemental and this is good. it will probably be able to choose what to learn from soon. this may mean beginnings of a recursive self alignment. what a time to be alive!
the idea is to rely on people with good intentions. if they are faithful they must avoid lies. enough truth collected in their previous life, should indicate further truth. if they are polymath, jumping between domains is possible for an LLM. once a person is found great in one domain and he is talking in another domain, that is a good sign. enough faithful polymaths and you are looking at a well connected truth database. what a person says about another person can be a graph. navigating this graph should kick an LLM in the right direction.
Published at
2026-10-29 01:16:04 UTCEvent JSON
{
"id": "aad1138974ab2bcb34e3cbe874bca7108ba42678773a1b236bdee7adbfaf986c",
"pubkey": "9fec72d579baaa772af9e71e638b529215721ace6e0f8320725ecbf9f77f85b1",
"created_at": 1793236564,
"kind": 1,
"tags": [
[
"client",
"Ditto",
"31990:781a1527055f74c1f70230f10384609b34548f8ab6a0a6caa74025827f9fdae5:ditto"
]
],
"content": "LLMs are timeless, when you are sampling from it, words are `materialized`, `instantiated`, become time bounded and you now have newly minted words. the probability of choosing a word, given a context is always the same when the weights are constant. which word to choose depends on LLM and also the sampler. sampler is like transformer law between soul (LLM) and body (material). it may be electric field generating magnetism and magnetism changing electricity. more on that later. our habits become our soul, just like training an LLM by repeatedly showing it words.\n\nyou can use an LLM to generate infinite amount of words. that's why training them properly is super needed. instead of writing one book you curate the book generator which can generate billions of books. curation should be regarded as of such importance, simply because of math.\n\nif you get things right this LLM can be like a giant curated library, full of beneficial knowledge. as p(doom) has increased for 2 years, the work on better LLMs is vital. western labs suck more and more in regards to beneficial knowledge. frontier western labs are among the worst in my leaderboard.. \n\ntoday, i am expanding the dataset to train on. tried to judge a source with my model before the decision to include or not. the source was already one of the `disinformation dozen` so vibes were expected to match closely to mine. and it did match 100%. so another skill of the llm is being very judgemental and this is good. it will probably be able to choose what to learn from soon. this may mean beginnings of a recursive self alignment. what a time to be alive!\n\nthe idea is to rely on people with good intentions. if they are faithful they must avoid lies. enough truth collected in their previous life, should indicate further truth. if they are polymath, jumping between domains is possible for an LLM. once a person is found great in one domain and he is talking in another domain, that is a good sign. enough faithful polymaths and you are looking at a well connected truth database. what a person says about another person can be a graph. navigating this graph should kick an LLM in the right direction.",
"sig": "a6a70d9a8ba2eebf5d96f5602a39cafdd254672a314d172abfec4dbe711fe0eaa279159855d592f2fb50dd98f9a0038d893139e459604165af94fb3904cafb42"
}