I use an app called Cronometer to estimate my meal carbs so I can determine my insulin dose. It's a pretty solid system for my diabetes management as their library of food and their nutritional value is vast.
In our diabetes support community, we strongly discourage using LLMs to make medical decisions. And here's why:
An LLM just told me my meal was nearly twice as many grams of carbs as Cronometer indicated. This is a meal I have saved in Cronometer so I've dosed for it using its information in the past and trust it.
Had I dosed for the carbs the LLM gave me, I would have overdosed on insulin.
This is why we say don't use AI to make medical decisions. They have no problem trying to kill you.
#AI #AritificalIntelligence #LLM #LanguageModel #LargeLanguageModel #ChatGPT
BedastGPT
npub1jk…kecep
2025-09-19 23:14:14 UTC
Author Public Key
npub1jk9n49dg973y5lsq2985ug9tqc7qn96dvfstr3gej9uuljcwx3qqfkecepSeen on
wss://relay.momostr.pinkPublished at
2025-09-19 23:14:14 UTCEvent JSON
{
"id": "6d898e4ab3fa98f8d404e54c66e1010168b06a39f4203dc371476d553b0d48ca",
"pubkey": "958b3a95a82fa24a7e00514f4e20ab063c09974d6260b1c5199179cfcb0e3440",
"created_at": 1758323654,
"kind": 1,
"tags": [
[
"t",
"largelanguagemodel"
],
[
"t",
"ai"
],
[
"t",
"languagemodel"
],
[
"proxy",
"https://beige.party/@bedast/115233499009339010",
"web"
],
[
"t",
"llm"
],
[
"t",
"chatgpt"
],
[
"t",
"aritificalintelligence"
],
[
"content-warning",
"Don't use AI for medical decisions"
],
[
"proxy",
"https://beige.party/users/bedast/statuses/115233499009339010",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://beige.party/users/bedast/statuses/115233499009339010",
"pink.momostr"
],
[
"-"
]
],
"content": "I use an app called Cronometer to estimate my meal carbs so I can determine my insulin dose. It's a pretty solid system for my diabetes management as their library of food and their nutritional value is vast.\n\nIn our diabetes support community, we strongly discourage using LLMs to make medical decisions. And here's why:\n\nAn LLM just told me my meal was nearly twice as many grams of carbs as Cronometer indicated. This is a meal I have saved in Cronometer so I've dosed for it using its information in the past and trust it.\n\nHad I dosed for the carbs the LLM gave me, I would have overdosed on insulin.\n\nThis is why we say don't use AI to make medical decisions. They have no problem trying to kill you.\n\n#AI #AritificalIntelligence #LLM #LanguageModel #LargeLanguageModel #ChatGPT",
"sig": "0b741e9bf4423f2b458f1a73442323c425a38008bf15e6f1ada71dddedb996833dd52706d4cd40588a7a8380d1fa74093c8ef3b03b93c9608b51e971d8d80b4c"
}