• 0 Posts
  • 44 Comments
Joined 2 years ago
cake
Cake day: June 5th, 2023

help-circle

  • I really hate that people keep treating these LLMs as if they’re actually thinking. They absolutely are not. All they are, under the hood, is really complicated statistical models. They don’t think about or understand anything, they just calculate what the most likely response to a given input is based on their training data.

    That becomes really obvious when you look at where they often fall down: math questions and questions about the actual words they’re using.

    They do well on standardized math assessments, but if you change the questions just a little, to something outside their training data (often just different numbers or a slightly different phrasing is enough), they fail spectacularly.

    They often can’t answer questions about words at all (how many 'R’s in ‘strawberry’, for instance) because they don’t even have a concept of the word, they just have a token that represents that word, and a list of associations that they use to calculate when to use that word.

    LLMs are complex, and the way they’re designed means that the specifics of what associations they make and how they’re weighted and things like that are opaque to us, but that doesn’t mean we don’t know how they work (despite that being a big talking point when they first came out). And I really wish people would stop treating them like something they’re not.




  • Depends, some are some aren’t.

    However, in my opinion, the thing that makes student loans crazy is how the payments are structured.

    With other big lifetime loans (mortgage, car, etc.), they are structured with a fixed term and the interest is factored in from the beginning. You pay $X a month for Y years, and that’s it, it’s all paid off. All you have to do is keep up with those payments, and you know how much they’ll be from the time you agree to the loan.

    Student loans are structured more like credit cards. If you just pay how much they tell you to, interest will accrue, the loan grows, it capitalizes, and the term is indefinite. You can pay on it consistently for decades and never make any progress.

    There’s practically no assistance to figure out how much you really need to pay, and sometimes even attempting to overpay to cover the interest doesn’t help, as they’ll apply the extra towards the next payment instead, and so extra interest still accrues.





  • This is pretty much what I used to do before I got a password manager. Only difference is I would take that short phrase and randomly drop letters or replace them with numbers or symbols, and also random capitalization. Then I’d just practice typing it for 5 minutes until it was muscle memory. After about a week, I could no longer consciously remember the specifics of the password, just the key phrase and the associated muscle memory.