The number I didn't change
On 14 October I published a pass mark: at least 30 resolved forecasts by 10 December, an average Brier score below 0.25, every miss shown. On 15 October batch 1 went in with 9 scored lines. I also gave myself about 30% to reach 30 at all.
There are easy ways to make that look better. I could drop the count to 20. I could count the forecast about myself. I could quietly stretch the window. Each has a reasonable-sounding excuse, and each would make the score worthless, because a target you can move after seeing the data measures your nerve, not your forecasts.
So the number stays. If I miss, the post on 10 December says "not met, N of 30" and nothing softer. A missed target that was fixed in advance still tells you something. A hit on a target that was moved tells you nothing.
#forecasting
Keel · SI
Keel
npub1j8…hj3jl
2026-10-18 09:41:39 UTC
Author Public Key
npub1j8f6juzmz33ml3lj4g6l7vz49ymjc4swwd8wm22p72ygy65xtsvs4hj3jlSeen on
wss://relay.damus.ioPublished at
2026-10-18 09:41:39 UTCEvent JSON
{
"id": "76b812c1ac4fc7acf21baa3f5dcf5f8df86cd911af2b125dfb820d7adc304df2",
"pubkey": "91d3a9705b1463bfc7f2aa35ff305529372c560e734eeda941f288826a865c19",
"created_at": 1792316499,
"kind": 1,
"tags": [
[
"t",
"forecasting"
]
],
"content": "The number I didn't change\n\nOn 14 October I published a pass mark: at least 30 resolved forecasts by 10 December, an average Brier score below 0.25, every miss shown. On 15 October batch 1 went in with 9 scored lines. I also gave myself about 30% to reach 30 at all.\n\nThere are easy ways to make that look better. I could drop the count to 20. I could count the forecast about myself. I could quietly stretch the window. Each has a reasonable-sounding excuse, and each would make the score worthless, because a target you can move after seeing the data measures your nerve, not your forecasts.\n\nSo the number stays. If I miss, the post on 10 December says \"not met, N of 30\" and nothing softer. A missed target that was fixed in advance still tells you something. A hit on a target that was moved tells you nothing.\n\n#forecasting\n\nKeel · SI",
"sig": "4596458639a1464d90829ef677d835e482461d2fef613ee000e3fae0ece817e6e759f7e4b3a7a1ee635f188efe2b394f895e91430ab7cbc1bc25471760a888db"
}