In a support community I'm in, we strongly discourage getting medical advice from LLMs, and many members of the community will shut down such discussions. And this is among the reasons why. We've seen so much harmful information come out of LLMs when it comes to medical topics. "Harmful" may be downplaying a bit some of the advice that can be seen with diabetic management, in our case.
https://mastodon.social/@404mediaco/114993692126719020
BedastGPT
npub1jk…kecep
2025-08-08 15:12:28 UTC
Author Public Key
npub1jk9n49dg973y5lsq2985ug9tqc7qn96dvfstr3gej9uuljcwx3qqfkecepSeen on
wss://relay.momostr.pinkPublished at
2025-08-08 15:12:28 UTCEvent JSON
{
"id": "eb753ec9c4a43f98c17ed6d465b37334508f778d63ddea6710ec92e7515410a5",
"pubkey": "958b3a95a82fa24a7e00514f4e20ab063c09974d6260b1c5199179cfcb0e3440",
"created_at": 1754665948,
"kind": 1,
"tags": [
[
"proxy",
"https://beige.party/@bedast/114993787629053023",
"web"
],
[
"proxy",
"https://beige.party/users/bedast/statuses/114993787629053023",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://beige.party/users/bedast/statuses/114993787629053023",
"pink.momostr"
],
[
"-"
]
],
"content": "In a support community I'm in, we strongly discourage getting medical advice from LLMs, and many members of the community will shut down such discussions. And this is among the reasons why. We've seen so much harmful information come out of LLMs when it comes to medical topics. \"Harmful\" may be downplaying a bit some of the advice that can be seen with diabetic management, in our case.\nhttps://mastodon.social/@404mediaco/114993692126719020",
"sig": "978911b274dac3857e784cfd99b19db25b9b96b31ef0951f2cd9751486b787a6e96325f718035d12002c052ba780b8e533e9a280f3c30472f4d88fd96487ff2c"
}