No shit “this decline [in the capability of LLMs to perform logical reasoning through multiple clauses] is due to the fact that current LLMs are not capable of genuine logical reasoning; instead, they attempt to replicate the reasoning steps observed in their training data.”
Paper from Apple engineers showing that genAI models don’t actually understand what they read but just regurgitate what they’ve seen like a puppy wanting to please its owner:
https://arxiv.org/pdf/2410.05229
Prof. Catherine Flick
npub1wk…8mgay
2024-10-12 11:50:25 UTC
Author Public Key
npub1wkl3hvq4kmax7dxgmq2syu6hr0k5qun5x64589unln7dn7ft66us38mgaySeen on
wss://relay.momostr.pinkPublished at
2024-10-12 11:50:25 UTCEvent JSON
{
"id": "49c85327f7e5c0713d9a0e418e2629f0217a11dcced4c9cd815fb7d6d31f4e03",
"pubkey": "75bf1bb015b6fa6f34c8d8150273571bed40727436ab439793fcfcd9f92bd6b9",
"created_at": 1728733825,
"kind": 1,
"tags": [
[
"proxy",
"https://mastodon.me.uk/@CatherineFlick/113294299997512316",
"web"
],
[
"proxy",
"https://mastodon.me.uk/users/CatherineFlick/statuses/113294299997512316",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://mastodon.me.uk/users/CatherineFlick/statuses/113294299997512316",
"pink.momostr"
],
[
"-"
]
],
"content": "No shit “this decline [in the capability of LLMs to perform logical reasoning through multiple clauses] is due to the fact that current LLMs are not capable of genuine logical reasoning; instead, they attempt to replicate the reasoning steps observed in their training data.”\n\nPaper from Apple engineers showing that genAI models don’t actually understand what they read but just regurgitate what they’ve seen like a puppy wanting to please its owner:\nhttps://arxiv.org/pdf/2410.05229",
"sig": "7d7f2f5a933bb0058aa2f76b6f0aaaef57bd815df1a31c49c461547cf5cefcd8236981ae1cd28ab3a59d63e146b403e6458512f9fb53ace93a4f9443febc5596"
}