THANK YOU. I have heard "you can run an LLM at home" used to dismiss everything from the data and labor theft to the environmental devastation, and like not to be a curmudgeon but please think about this for more than five seconds
The places where my skills are employable are all Silicon Valley jawns, plus a few financial institutions. Been there, did that, literally have the t-shirts.
fuckin i ask what a commercial rate of API provision of LLMs would cost once the bubble pops and i get nerds going "oh it's easy you can just run a model at home"
I draw the line at family tech support some leagues short of dealing with that even if Apple and Microsoft ship it at the OS level (which... you know they'll try)
macOS 20 (Miracle) will be the first Apple operating system that cannot be downloaded but is instead installed by plugging in a physical device containing 4TB of storage chips; the device ssd layers on top. Requires a minimum of 64GB of memory, two RTX cards, and only runs if cooled to -5 Celsius.
how many API calls is a fucking 5090 nerd or are you counting that as free cos who in the general useless MF who outsourced their brain to ChatGPT market *doesn't* have nvidia's latest to hand
> I have, in fact, because I keep getting asked what it would cost to spin up "local" "AI" bullshit in AWS.
> If you want to run any of the 'mid-tier' models: over $35,000 a month.
Comments
"We've got LLM's at home."
[The LLM at home]
[Picture of a Cards Against Humanity deck]
NO THEY WON'T YOU CLEARLY KNOW NOTHING OR YOU WOULD KNOW THE UNSTOPPABLE DRIVE TO INHOUSE NOTHING AND SAAS EVERYTHING EVEN AT 10x THE PRICE
fucking nerds
The places where my skills are employable are all Silicon Valley jawns, plus a few financial institutions. Been there, did that, literally have the t-shirts.
Go back? Hard pass.
and then the home LLM software is technically less thorougly a fractal of broken design than cryptocurrency, though only just
fuckin funroll loops grandma
> I have, in fact, because I keep getting asked what it would cost to spin up "local" "AI" bullshit in AWS.
> If you want to run any of the 'mid-tier' models: over $35,000 a month.
subthread: https://weird.autos/@rootwyrm/114650039039594299