• 4 Posts
  • 8.24K Comments
Joined 3 years ago
cake
Cake day: June 20th, 2023

help-circle
  • Jesus that is bonkers. 480GB on one GPU? I get why (model size and context headroom)… but that’s gonna be closing in on $100k (MSRP of an NVDA B300 - iirc their current top-end - is $50-60k, and that only (hah) brings 288GB).

    Tangentially: I really wish the big US LLM players would stop fucking brute forcing their development by throwing silicon at everything. It seems embedded/austere/efficient coding techniques and algorithms are just being straight up discarded and forgotten. Tbh, this is a pattern I’ve observed as a slow creep since the advent of AWS and The Cloud a couple decades ago - the “AI” bubble is just accelerating the trend. The narrative (irritatingly parroted by my manager) is always “make it work, then make it efficient later” - but it’s always put in the tech debt bucket, so “later” is actually “never”. China is absolutely running way ahead of the US these days in terms of nurturing incisive and efficient engineering culture - it’s not even close. The fact that it’s essentially borne out of ITAR restrictions on the most advanced GPU tech is incidental; really, in a pretty significant way, the US kinda unintentionally did them a favor by constraining their hardware tier, because it forced them to write better code to make up for it. And they have been writing better code for a while now, especially in the LLM domain.



  • Honestly, I have a truly biblical amount of anger at the DNC for being such consummate imbeciles and yet again snatching defeat from the jaws of victory. It was basically a slam dunk… and fucking Harris and her campaign and the DNC and the fuckwit political consultants just proceeded to drill a three-pointer from half-court into their own basket.

    Turns out that people won’t show up for you if they’re just kinda angry at the status quo, and your pitch is “it’ll be more of the same”.


  • Honestly, I’m becoming convinced that crashing the availability of meaningfully performant consumer-purchasable machines is an intentional and explicit element of the plan. The captains of industry are predicating a HUGE part of their value proposition on making “edge compute” live in datacenters, and never on client machines, full stop.

    The dream of the Captains of Industry is to sell us subscriptions for literally everything and anything they can. You can already see this happening with PC remote gaming services getting more and more prevalent.

    Go on eBay (or <insert-regional-equivalent-here>); look for good condition enterprise components; build a homelab. The cloud is just someone else’s computer - be your own cloud.

    Also, check out and get into mesh networking.












  • Eh. I don’t think it says anything at all about their desire to be an artist. I think it says a lot more about their:

    • greed (desire to be paid, regardless of what they’re being paid for)
    • cheapness (not wanting to pay a proper artist)
    • antisocial (as in: counter to the ethos of social collaboration; not as in “I want to be a potato today”) tendencies
    • low ethical standards (not caring that the training sets for all of this are built almost exclusively from stolen contracts)
    • self aggrandizement / narcissism (claiming aptitude and credit in a domain that you don’t actually have any skill in, but pretending you do anyways)

    I don’t think wanting or not wanting to be able to do art is a major aspect of this at all. It’s largely about wanting the money and, sometimes, the recognition, without doing any of the work it normally takes for humans to get to that point of expertise.