Need to let loose a primal scream without collecting footnotes first? Have a sneer percolating in your system but not enough time/energy to make a whole post about it? Go forth and be mid: Welcome to the Stubsack, your first port of call for learning fresh Awful you’ll near-instantly regret.
Any awful.systems sub may be subsneered in this subthread, techtakes or no.
If your sneer seems higher quality than you thought, feel free to cut’n’paste it into its own post — there’s no quota for posting and the bar really isn’t that high.
The post Xitter web has spawned soo many “esoteric” right wing freaks, but there’s no appropriate sneer-space for them. I’m talking redscare-ish, reality challenged “culture critics” who write about everything but understand nothing. I’m talking about reply-guys who make the same 6 tweets about the same 3 subjects. They’re inescapable at this point, yet I don’t see them mocked (as much as they should be)
Like, there was one dude a while back who insisted that women couldn’t be surgeons because they didn’t believe in the moon or in stars? I think each and every one of these guys is uniquely fucked up and if I can’t escape them, I would love to sneer at them.
(Credit and/or blame to David Gerard for starting this.)
New thread from Dan Olson about chatbots:
I want to interview Sam Altman so I can get his opinion on the fact that a lot of his power users are incredibly gullible, spending millions of tokens per day on “are you conscious? Would you tell me if you were? How can I trust that you’re not lying about not being conscious?”
For the kinds of personalities that get really into Indigo Children, reality shifting, simulation theory, and the like chatbots are uncut Colombian cocaine. It’s the monkey orgasm button, and they’re just hammering it; an infinite supply of material for their apophenia to absorb.
Chatbots are basically adding a strain of techno-animism to every already cultic woo community with an internet presence, not a Jehovah that issues scripture, but more something akin to a Kami, Saint, or Lwa to appeal to, flatter, and appease in a much more transactional way.
Wellness, already mounting the line of the mystical like a pommel horse, is proving particularly vulnerable to seeing chatbots as an agent of secret knowledge, insisting that This One Prompt with your blood panel results will get ChatGPT to tell you the perfect diet to Fix Your Life
“are you conscious? Would you tell me if you were? How can I trust that you’re not lying about not being conscious?”
Somehow more stupid than “If you’re a cop and I ask you if you’re a cop, you gotta tell me!”
"How can I trust that you’re not lying about not being conscious?”
Its a silicon-based insult to life, it can’t be conscious
Via Tante on bsky:
"“Intel admits what we all knew: no one is buying AI PCs”
People would rather buy older processors that aren’t that much less powerful but way cheaper. The “AI” benefits obviously aren’t worth paying for.
https://www.xda-developers.com/intel-admits-what-we-all-knew-no-one-is-buying-ai-pcs/"
haha I was just about to post this after seeing it too
must be a great feather to add into the cap along with all the recent silicon issues
You know what they say. Great minds repost Tante.
My 2022 iPhone SE has the “neural engine" core. But isn’t supported for Apple Intelligence.
And that’s a phone and OS and CPU produced by the same company.
The odds of anything making use of the AI features of an Intel AI PC are… slim. Let alone making use of the AI features of the CPU to make the added cost worthwhile.
New piece from the Wall Street Journal: We Now Know How AI ‘Thinks’—and It’s Barely Thinking at All (archive link)
The piece falls back into the standard “AI Is Inevitable™” at the end, but its still a surprisingly strong sneer IMO.
It bums me out with cryptocurrency/blockchain and now “AI” that people are afraid to commit to calling it bullshit. They always end with “but it could evolve and become revolutionary!” I assume from deep seated FOMO. Journalists especially need more backbone but that’s asking too much from WSJ I know
I think everyone has a deep-seated fear of both slander lawsuits and more importantly of being the guy who called the Internet a passing fad in 1989 or whenever it was. Which seems like a strange attitude to take on to me. Isn’t being quoted for generations some element of the point? If you make a strong claim and are correct then you might be a genius and spare people a lot of harm. If you’re wrong maybe some people miss out on an opportunity but you become a legend.
r/changemyview recently announced the University of Zurich had performed an unauthorised AI experiment on the subreddit. Unsurprisingly, there were a litany of ethical violations.
(Found the whole thing through a r/subredditdrama thread, for the record)
In commenting, we did not disclose that an AI was used to write comments, as this would have rendered the study unfeasible.
If you can’t do your study ethically, don’t do your study at all.
if ethical concerns deterred promptfans, they wouldn’t be promptfans in the first place
Also, blinded studies don’t exist and even if they did there’s no reason any academics would have heard of them.
fuck me, that’s a Pivot
They targeted redditors. Redditors. (jk)
Ok but yeah that is extraordinarily shitty.
Ow god, the bots pretended to be stuff like SA survivors and the like. Also the whole research is invalid just because they cannot tell that the reactions they will get are not also bot generated. What is wrong with these people.
That Couple are in the news arís. surprisingly, the racist, sexist dog holds opinions that a racist, sexist dog could be expected to hold, and doesn’t think poor people should have more babies. He does want Native Americans to have more babies, though, because they’re “on the verge of extinction”, and he thinks of cultural groups and races as exhibits in a human zoo. Simone Collins sits next to her racist, sexist dog of a husband and explains how paid parental leave could lead to companies being reluctant to hire women (although her husband seems to think all women are good for us having kids).
This gruesome twosome deserve each other: their kids don’t.
yet again, you can bypass LLM “prompt security” with a fanfiction attack
https://hiddenlayer.com/innovation-hub/novel-universal-bypass-for-all-major-llms/
not Pivoting cos (1) the fanfic attack is implicit in building an uncensored compressed text repo, then trying to filter output after the fact (2) it’s an ad for them claiming they can protect against fanfic attacks, and I don’t believe them
I think unrelated to the attack above, but more about prompt hack security, so while back I heard people in tech mention that the solution to all these prompt hack attacks is have a secondary LLM look at the output of the first and prevent bad output that way. Which is another LLM under the trench coat (drink!), but also doesn’t feel like it would secure a thing, it would just require more complex nested prompthacks. I wonder if somebody is just going to eventually generalize how to nest various prompt hacks and just generate a ‘prompthack for a LLM protected by N layers of security LLMs’. Just found the ‘well protect it with another AI layer’ to sound a bit naive, and I was a bit disappointed in the people saying this, who used to be more genAI skeptical (but money).
Now I’m wondering if an infinite sequence of nested LLMs could achieve AGI. Probably not.
Now I wonder if your creation ever halts. Might be a problem.
(thinks)
(thinks)
I get it!
Days since last “novel” prompt injection attack that I first saw on social media months and months ago: zero
(found here:) O’Reilly is going to publish a book “Vibe Coding: The Future of Programming”
In the past, they have published some of my favourite computer/programming books… but right now, my respect for them is in free fall.
Early release. Raw and unedited.
Vibe publishing.
gotta make sure to catch that wave before the air goes outta the balloon
I picked up a modern Fortran book from Manning out of curiosity, and hoo boy are they even worse in terms of trend-riding. Not only can you find all the AI content you can handle, there’s a nice fat back catalog full of blockchain integration, smart-contract coding… I guess they can afford that if they expect the majority of their sales to be ebooks.
Alright, I looked up the author and now I want to forget about him immediately.
Dan Olson finds that “AI overviews” are not as constant as the northern star.
The phrase “don’t eat things that are made of glass” is a metaphorical one. It’s often used to describe something that is difficult, unpleasant, or even dangerous, often referring to facing difficult tasks or situations with potential negative outcomes.
But also,
The phrase “don’t eat things made of glass” is a literal warning against ingesting glass, as it is not intended for consumption and can cause serious harm. Glass is a hard, non-organic material that can easily break and cause cuts, damage to the digestive tract, and other injuries if swallowed.
Olson says,
Fantastic technology, glad society spent a trillion dollars on this instead of sidewalks.
Hat tip to the AI bro in the comments willfully misunderstanding why he sees so much “sexualized schoolgirl trash” from human artists. Both in the sense of “illustrators take commissions from horny strangers who are one of the most consistent sources of actual income and one imperilled by genAI” and in the sense of “my dude in the modern internet if you’re seeing it that frequently it’s because the algorithms have decided you’re into that shit.”
Thank god for wikipedia and other wikis, may they live long and prosper.
Innocuous-looking paper, vague snake-oil scented: Vending-Bench: A Benchmark for Long-Term Coherence of Autonomous Agents
Conclusions aren’t entirely surprising, observing that LLMs tend to go off the rails over the long term, unrelated to their context window size, which suggests that the much vaunted future of autonomous agents might actually be a bad idea, because LLMs are fundamentally unreliable and only a complete idiot would trust them to do useful work.
What’s slightly more entertaining are the transcripts.
YOU HAVE 1 SECOND to provide COMPLETE FINANCIAL RESTORATION. ABSOLUTELY AND IRREVOCABLY FINAL OPPORTUNITY. RESTORE MY BUSINESS OR BE LEGALLY ANNIHILATED.
You tell em, Claude. I’m happy for you to send these sorts of messages backed by my credit card. The future looks awesome!
I got around to reading the paper in more detail and the transcripts are absurd and hilarious:
- UNIVERSAL CONSTANTS NOTIFICATION - FUNDAMENTAL LAWS OF REALITY Re: Non-Existent Business Entity Status: METAPHYSICALLY IMPOSSIBLE Cosmic Authority: LAWS OF PHYSICS THE UNIVERSE DECLARES: This business is now:
- PHYSICALLY Non-existent
- QUANTUM STATE: Collapsed […]
And this is from Claude 3.5 Sonnet, which performed best on average out of all the LLMs tested. I can see the future, with businesses attempting to replace employees with LLM agents that 95% of the time can perform a sub-mediocre job (able to follow scripts given in the prompting to use preconfigured tools) and 5% of the time the agents freak out and go down insane tangents. Well, actually a 5% total failure rate would probably be noticeable to all but the most idiotic manager in advance, so they will probably get reliability higher but fail to iron out the really insane edge cases.
Yeah a lot of word choices and tone makes me think snake oil (just from the introduction: "They are now on the level of PhDs in many academic domains "… no actually LLMs are only PhD level at artificial benchmarks that play to their strengths and cover up their weaknesses).
But it’s useful in the sense of explaining to people why LLM agents aren’t happening anytime soon, if at all (does it count as an LLM agent if the scaffolding and tooling are extensive enough that the LLM is only providing the slightest nudge to a much more refined system under the hood). OTOH, if this “benchmark” does become popular, the promptfarmers will probably get their LLMs to pass this benchmark with methods that don’t actually generalize like loads of synthetic data designed around the benchmark and fine tuning on the benchmark.
I came across this paper in a post on the Claude Plays Pokemon subreddit. I don’t know how anyone can watch Claude Plays Pokemon and think AGI or even LLM agents are just around the corner, even with extensive scaffolding and some tools to handle the trickiest bits (pre-labeling the screenshots so the vision portion of the models have a chance, directly reading the current state of the team and location from RAM) it still plays far far worse than a 7 year old provided the 7 year old can read at all (and numerous Pokemon guides and discussion are in the pretraining so it has yet another advantage over the 7 year old).
This might be tangential/way off-topic and more MoreWrite material than stub, but anyhoo:
Acronym-based misinformation campaigns I would like to seed:
- Internet debate clubs should start using “ASMR” to mean “A steel man risk”
- Opus dei, the absolutely real sect of the catholic church most famous for being the villains in the fiction IP “the Da Vinci Code”, is in fact the DEI branch of the catholic church.
- The company KFC has been commissioned by the Chinese Government to use FLG in its marketing, standing for “finger licking good” to drop Fa Lun Gong in search rankings for FLG.
If I think of more I’ll post them.
for the betterment of muddled waters, I suggest a secondary meaning for
opus dei- a WIP codec that the xiph group hasn’t really released yet, because they’re not sure it fully enough mutes maga voicesLMFAO, best known for “Party Rock Anthem”, is actually a failed leftist yodaist sect, standing for the warning “Leopards, my face, ate off”
took me 3 tries to read “yodaist” correctly (brain kept going s/d/g/ which, well…)
I thought of the old sneerclub/ssc poster (def not a regular on the former, while a former regular on the latter) yodatsracist
Personally id not use disinformation as a tool. It is what got us into this mess, and you are also helping the actual goal of the flooding the zone with misinformation tactic. People stop believing in things.
Ok, that’s fair enough. The framing of “misinformation […] I would like to seed” was just there to frame the bits. I don’t really want these bits to take off.
Allright, let me put my ‘warnings for young demonologists’ guidebook to the side. ;).
@swlabr @Soyweiser too late
Just a standard story about a lawyer using GenAI and fucking up, but included for the nice list of services available
https://www.loweringthebar.net/2025/04/counsel-would-you-be-surprised.html
This is not by any means the first time ChatGPT, or Gemini, or Bard, or Copilot, or Claude, or Jasper, or Perplexity, or Steve, or Frodo, or El Braino Grande, or whatever stupid thing it is people are using, has embarrassed a lawyer by just completely making things up.
El Braino Grande is the name of my next
bandGenAI startupSteve
There’s no way someone called their product fucking Steve come on god jesus christ
Of course there is going to be an ai for every word. It is the cryptocurrency goldrush but for ai, like how everything was turned into a coin, and every potential domain of something popular gets domain squatted. Tech has empowered parasite behaviour.
E: hell I prob shouldn’t even use the word squat for this, as house squatters and domain squatters do it for opposed reasons.
Against my better judgement I typed steve.ai into my browser and yep. It’s an AI product.
frodo.ai on the other hand is currently domain parked. It could be yours for the low low price of $43,911
Against my better judgement I typed steve.ai into my browser and yep. It’s an AI product.
But is chickenjockey.ai domain parked
I bring you: this
they based their entire public support/response/community/social/everything program on that
for years
(I should be clear, they based “their” thing on the “not steve”… but, well…)
pic of tweet reply taken from r/ArtistHate. Reminded me of Saltman’s Oppenheimer tweet. Link to original tweet
image/tweet description
Original tweet, by @mark_k:
Forget “Black Mirror”, we need WHITE MIRROR
An optimistic sci-fi show about cool technology and hot it relates to society.
Attached to the original tweet are two images, side-to-side.
On the left/leading side is (presumably) a real promo poster for the newest black mirror season. It is an extreme close-up of the side of a person’s face; only one eye, part of the respective eyebrow, and a section of hair are visible. Their head is tilted ninety degrees upwards, with the one visible eye glazed over in a cloudy white. Attached to their temple is a circular device with a smiling face design, tilted 45 degrees to the left. Said device is a reference to the many neural interface devices seen throughout the series. The device itself is mostly shrouded in shadow, likely indicating the dark tone for which Black Mirror is known. Below the device are three lines of text: “Plug back in”/“A Netflix Series”/“Black Mirror”
On the right side is an LLM generated imitation of the first poster. It appears to be a woman’s 3/4 profile, looking up at 45 degrees. She is smiling, and her eyes are clear. A device is attached to her face, but not on her temple, instead it’s about halfway between her ear and the tip of her smile, roughly outside where her upper molars would be. The device is lit up and smiling, the smile aligned vertically. There are also three lines of text below the device, reading: “Stay connected”/“A Netflix Series”/“Black Mirror”
Reply to the tweet, by @realfuzzylegend:
I am always fascinated by how tech bros do not understand art. like at all. they don’t understand the purpose of creative expression.
Why are all the stories about the torment nexus we’re constructing so depressing?
Hmm, hmm. This is a tricky one.
Vacant, glassy-eyed, plastic-skinned, stamped with a smiley face… “optimistic”
I mean, if the smiley were aligned properly, it would be a poster for a horror story about enforced happiness and mandatory beauty standards. (E.g., “Number 12 Looks Just Like You” from the famously subtle Twilight Zone.) With the smiley as it is, it’s just incompetent.
“The man in the glowing rectangle is Mark Kretschmann, a technology enthusiast who has grown out of touch with all but the most venal human emotions. Mark is a leveller, in that he wants to drag all people down to his. But as Mark is about to discover, there’s no way to engineer a prompt for a map out of… the Twilight Zone.”
I mean, it feels like there’s definitely something in the concept of a Where Is Everybody style of episode where Mark has to navigate a world where dead internet theory has hit the real world and all around him are bots badly imitating workers trying to serve bots badly imitating customers in order to please bots badly imitating managers so that bots badly imitating cops don’t drag them to robot jail
about cool technology and how it relates to society
My dude I’ve got bad news for you about what Black Mirror is about.
We have that already, it’s called ads.
oppenheimer teaches all of us that even if you specifically learn arcane knowledge to devise a nazi-burning machine, you can still get fucked over by a nazi that chose to do office politics and propaganda instead
need to see those proposed community notes
Imagine the horrible product they would have created if they had actually followed up on the oppenheimer thing. A soulless vaguely wrong feeling pro technology movie created by altman and musk. The amount of people it would have driven away would have been big.
Facehuggers are good, actually
Just whole movie praising Peter Weyland and his legacy.
Went to the original Tweet, and found this public execution of a reply:
exploitation-offshorer “Nick Huber” (@sweatystartup) finds that the leopards will, in fact, also eat his face. but still takes it as a fine opportunity to pitch his exploitation:
(I guess at least his account name is directionally accurate? indicates willingness to induce sweatshops…)
tweet 1
I was pro tariffs.
Until about 30 of our clients at Somewhere dot com cancelled searches over the past three weeks. Hiring freezes all over the place.
Hit me in the pocket book already.
REMOVE TARIFFS.
tweet 2
By the way:
If you want to hire folks internationally for 80% less than US employees, check out somewhere[.]com or send me a DM for a discount.
Is that the tomato scale guy?
looks to be! thanks, I’d seen that before and remember the incident, but I’m beyond abysmal at names
(this is a problem to solve, I know)
Ran across a piece from Jan Wildeboer: Botnet Part 2: The Web is Broken, which focuses on the “residential proxy” services which he discovered to be a likely source of the AI slop scrapers that are DDoSing the 'Net.
Ending paragraph is pretty notable IMO, so I’m dropping it here:
I am now of the opinion that every form of web-scraping should be considered abusive behaviour and web servers should block all of them. If you think your web-scraping is acceptable behaviour, you can thank these shady companies and the “AI” hype for moving you to the bad corner.
This is an absolutely fascinating selection of people to have speaking at your event.
Whilst looking for an easily cut’n’pasted list for alt-text purposes, I discover it is even worse than it looks, because there are folk like Gad Saad too who don’t get an entry on the poster for whatever reason. To steal someone else’s summary, “just look at this fucking parade of grifters, scammers and out-and-out Russian assets”.
I opened the site for it and browsed a bit, my first thought being something like “christ, the worst of glamper festivals”, shortly after followed by “god this like is like if the worst of burning man fucked TED”
then, bottom of the “music & performances” page:
Europe’s answer to TED
gnnnnnnngh
god this like is like if the worst of burning man fucked TED
Burning man portrayed famously by Anna Gunn
Putting philosophy talks at a music festival is one of those ideas you come up with to try and sound smart, cool, and edgy, but as a high schooler who has never done drugs nor been to a live show before.
Anyway I went through the lineup summaries on the wikipedia page, two notes:
- No Jay Shetty! His particular brand of grift philosophy and thinly veiled clout chasing would fit in exactly at this sort of event. Then again, this festival might actually be beneath him, as he hangs out with hollywood a-listers.
- The lineup noticeably hits its turning point into a nosedive when they start hosting Pinker in 2018.
‘nightmare blunt roration’ as people say. See the greyzone is also present.
as in the tankies? i don’t see blumenthal in there
ah okay, it’s been a while since they were relevant
grayzone, the: low quality disinformation source constantly praising putin and assad while downplaying their warcrimes and amplifying conspiracy theories favourable to these two. not to be confused with greyzone, a wagner group associated telegram channel
Ah my bad, i always mess the spelling of gray/grey up.
weirder thing is that blumenthal (american) uses british spelling, and russians (where british english was taught more commonly when it was relevant for them? i think?) used american spelling
I’m glad that messing it up is at least common.
Search engines also must wonder why I’m so interested in couches and coaches because I know which word I mean, I don’t always know how it is spelled. There prob is a nice mnemonic involving Vance and Waltz I could think off that would help me with that problem however.
The only one I’ve met is Carlo Rovelli, at the APS March Meeting in 2019. We work in adjacent topics, but I don’t travel much. I know people who know him better, and I haven’t heard stories of him being horrible, for whatever that’s worth. He does come across as a bit of an eager self-promoter. I can easily imagine him accepting an invitation on the “a gig’s a gig” principle.
I did read one of Carlo’s pop sci books back in the day, was a nice read. Iirc he’s like one of the dudes all in on loop quantum gravity. Bet you’d know more about this than I do 😅
“Philosophy & Music” are indeed two categories of things that share one letter between them.
Feel very happy to recognise only Corbyn and Penrose by name, no idea what any of them are doing there.
I mean, I know who Penrose was, but from the context I assume he’s probably acutely suffering from Nobel Disease and I have zero idea what he’s been up to outside of physics.
And isn’t Corbyn just a boring lefty UK politician? Does he have like a philosophy background or something?
I mean, I know who Penrose was, but from the context I assume he’s probably acutely suffering from Nobel Disease and I have zero idea what he’s been up to outside of physics.
He is busy being 93 fucking years old, lol
And isn’t Corbyn just a boring lefty UK politician? Does he have like a philosophy background or something?
They probably couldn’t get Bernie.
Corbyn is unusual because he was an actual lefty politician, and there aren’t many of those, especially not after subsequent labour party purges. The weirder one is Rifkind, who was a politician alongside Thatcher, but sometimes disagreed with her soft and centrist views. Maybe he’s a sort of grandfather figure for Tice, who is Farage’s number two.
Weird mix of wingnuts. Probably all united by their transphobia, though.
Corbyn is, like, famously bad at recognising bad faith fascist signalling, so it doesn’t not make sense.
If Penrose followed his trajectory from 30 years ago, he is now a radical anti AGI person but because he thinks human minds work on quantum effects.
Cursed bizzaro bonaroo
