Is… Is this a New Vegas reference? Or a different evil toaster? Find out this and more on the next exciting episode of: Extreme Hillbilly Armageddon T-Rex Jamboree 7
Is… Is this a New Vegas reference? Or a different evil toaster? Find out this and more on the next exciting episode of: Extreme Hillbilly Armageddon T-Rex Jamboree 7
See, I’m not sure whether that’s true. Putting grok in a toaster seems difficult. It currently requires a medium-size town’s worth of water and enough space to fit several thousand loaves of bread. Is grok in a toaster if I put my phone in a toaster with grok pulled up? Or should we consider an industrial bakery a toaster?
Edit: I goof’d and cut out the punchline while editing and now I can’t remember it. Shame me for my incompetence
Well, training an LLM and running that trained LLM are two different things. You can run a trained LLM on a home PC, which admittedly is probably still too much for anything that you could put into a toaster before it just becomes a PC with a toaster.
Do they really run completely locally? I honestly had no clue. I figured they’d take vast computing power to run as well as train
Yup. I’ve run some on my gaming rig. They just have the normal lack of reasoning and therefore lack of use.
The only reason the fuckheads running grok need that much water and power is because they have thousands of users pinging it. Shove the model in a toaster and it’ll run, just only for one user though.
There are single board computers out there marketed for AI use like the Nvidia Jetson nano, and LattePanda’s boards. You can run generative AI on them, it’s just going to be a little slower.
AFAIK you can even train really small models at home, too, they’ll just be even less useful than the big ones.
I had some! They can be pretty endearing, like houseplants to water. Which is why I stopped using them entirely. Seeing it compose sentences was neat, but intensely uncanny and I just need to kill it now get it away from me fucking die. Kinda like modern AI.