those frameworks are old but very popular.
The models that you and I are using require thousands of GPU's to complete a training run in 2 - 3 weeks. That adds up to millions of dollars in GPU rental cost.
This is covered a little bit in this book I read:
Build a Large Language Model (From Scratch): Raschka, Sebastian: 9781633437166: Amazon.com: Books https://share.google/7z5GA1OjKbg9esxz7
I used PyTorch to recreate GPT-2.
David Bucienski
npub123…579w6
2026-07-20 19:55:41 UTC
in reply to nevent1q…fx38
Author Public Key
npub123t95x6c537zd5tvw6p7lfnd6p7uhwnrnxsxz20u86rzccvrd83s2579w6Seen on
wss://relay.momostr.pinkPublished at
2026-07-20 19:55:41 UTCEvent JSON
{
"id": "5163cef00a39aa348dacf0a4bb5596d9bc82758833065ff6409f9b9f4c9e0b92",
"pubkey": "54565a1b58a47c26d16c7683efa66dd07dcbba6399a06129fc3e862c618369e3",
"created_at": 1784577341,
"kind": 1,
"tags": [
[
"proxy",
"https://noauthority.social/@DavidB/116954060628404763",
"web"
],
[
"p",
"4194804161bbde4a6848cc2f7de4ed22eb6b55685bda4081b6a940e1f5968fa5"
],
[
"p",
"134923ad77a79e45dddf47a4ce8b36e1fc1270f0df735f34056598759a5c8bd6"
],
[
"p",
"54565a1b58a47c26d16c7683efa66dd07dcbba6399a06129fc3e862c618369e3"
],
[
"e",
"3ab9877fca090d803285489eb5e206952d5a47807809b02f7cce665a47b22d52",
"",
"root",
"4194804161bbde4a6848cc2f7de4ed22eb6b55685bda4081b6a940e1f5968fa5"
],
[
"e",
"30f903cae194f53eb6e5ec8e97b78e521ff087d36204bd3e464c8533a212e6bd",
"",
"reply",
"134923ad77a79e45dddf47a4ce8b36e1fc1270f0df735f34056598759a5c8bd6"
],
[
"proxy",
"https://noauthority.social/users/DavidB/statuses/116954060628404763",
"activitypub"
],
[
"L",
"pink.momostr"
],
[
"l",
"pink.momostr.activitypub:https://noauthority.social/users/DavidB/statuses/116954060628404763",
"pink.momostr"
],
[
"-"
]
],
"content": "those frameworks are old but very popular. \n\nThe models that you and I are using require thousands of GPU's to complete a training run in 2 - 3 weeks. That adds up to millions of dollars in GPU rental cost.\n\nThis is covered a little bit in this book I read:\n\nBuild a Large Language Model (From Scratch): Raschka, Sebastian: 9781633437166: Amazon.com: Books https://share.google/7z5GA1OjKbg9esxz7\n\nI used PyTorch to recreate GPT-2.",
"sig": "b536dcb47969ed19f5cc899618348b7073e37b0c81ce70842398f6d9903201a80d9c2c52b4dd2908ce2fa7985438378cbc0e390f6a1b89aa5894aaa69aa82530"
}