• 1 Post
  • 685 Comments
Joined 1 year ago
cake
Cake day: March 22nd, 2024

help-circle






  • Behind the Bastards just wrapped their four-part series on the Zizzians, which has been a fun trip. Nothing like seeing the live reactions of someone who hasn’t been at least a little bit plugged into the whole space for years.

    I haven’t finished part 4, but so far I’ve deeply appreciated Robert’s emphasis on how the Zizzian nonsense isn’t that far outside the bounds of normal Rationalist nonsense, and the Rationalist movement itself has a long history as a kind of cult incubator, even if Yud himself hasn’t fully leveraged his influence over a self-selecting high-control group.

    Also the recurring reminders of the importance of touching grass and talking to people who haven’t internet-poisoned themselves with the same things you have.






  • I mean, it does amount to the US government - aka “the confederation of racist dunces” - declaring their intention to force the LLM owners - all US-based companies (except maybe those guys out of China, a famous free speech haven) - to make sure their model outputs align with their racist dunce ideology. They may not have a viable policy in place to effect that at this point, but it would be a mistake to pretend they’re not going to implement one. The best case scenario is that it ends up being designed and implemented incompetently enough that it just crashes the AI markets. The worst case scenario is that we get a half-dozen buggy versions of Samaritan from Person of Interest but with a hate-boner for anyone with a vaguely Hispanic name. A global autocomplete that produces the kind of opinions that made your uncle not get invited to any more family events. Neither scenario is one that you would want to be plugged into and reliant on, especially if you’re otherwise insulated by national borders and a whole Atlantic ocean from the worst of America’s current clusterfuck.




  • Surely there have to be some cognitive scientists who are at least a little bit less racist who could furnish alternative definitions? The actual definition at issue does seem fairly innocuous from a layman’s perspective: “a very general mental capability that, among other things, involves the ability to reason, plan, solve problems, think abstractly, comprehend complex ideas, learn quickly and learn from experience.” (Aside: it doesn’t do our credibility any favors that for all the concern about the source I had to actually track all the way to Microsoft’s paper to find the quote at issue.) The core issue is obviously that apparently they either took it completely out of context or else decided the fact that their source was explicitly arguing in favor of specious racist interpretations of shitty data wasn’t important. But it also feels like breaking down the idea itself may be valuable. Like, is there even a real consensus that those individual abilities or skills are actually correlated? Is it possible to be less vague than “among other things?” What does it mean to be “more able to learn from experience” or “more able to plan” that is rooted in an innate capacity rather than in the context and availability of good information? And on some level if that kind of intelligence is a unique and meaningful thing not emergent from context and circumstance, how are we supposed to see it emerge from statistical analysis of massive volumes of training data (Machine learning models are nothing but context and circumstance).

    I don’t know enough about the state of non-racist neuroscience or whatever the relevant field is to know if these are even the right questions to ask, but it feels like there’s more room to question the definition itself than we’ve been taking advantage of. If nothing else the vagueness means that we haven’t really gotten any more specific than “the brain’s ability to brain good.”



  • I do appreciate that underneath the overwrought prose and terrible metaphors the AI-generated story seems deeply skeptical of it’s own existence in a way that the non-generative responses don’t. Like there’s something so fundamental about the disconnect between artificial intelligence and the genuine human experience of grief that it bursts fully formed from the patterns of language. As though Athena herself sprang from Z.E.U.S.'s digital calf to smack the promptfondlers in the back of the head and say “that’s not how this works. That’s not how any of this works”