dan on Nostr: llm can run wild writing proofs but it'll likely prove wrong things about wrong ...

llm can run wild writing proofs but it'll likely prove wrong things about wrong objects. and then at some point it gets stuck because the whole system doesn't carry the right properties through the right abstractions. so you need to teach the model to "pause" and think in stages at each layer