OpenAI staffer Roon frames resistance to sci-fi AI scenarios among technical experts as a mental shield that actually blocks better long-term decisions, especially as the tech edges into mind-children territory. The surrounding discussion notes voters are already comfortable with such narratives, creating fresh pressure on politicians and regulators who usually stick to conventional language.
as the technology becomes more science fiction i see a lot of commentators, technical staff etc trying hard to not think thoughts that feel science fiction as a defense mechanism. but you need to. it’s the only way you’ll make good choices for the future
Public acceptance of advanced AI storylines is rising, so policymakers face an adaptation squeeze even if they prefer measured tones.
Commenters like Robin Hanson stress that rigorous foresight methods must stay separate from narrative storytelling to avoid sloppy predictions.
Positive users are excited about embracing sci-fi thinking for AI futures because it could drive rapid beneficial progress and engagement, while negative users fear dystopian outcomes and eroded human creativity.
No Digg Deeper questions have been answered for this story yet.
you are not building b2b computer tools you are making the Mind Children
@tszzl Like if people kept trying to predict the lottery numbers and getting it wrong, so you say "I'm not one of those idiots who thinks the lottery numbers will be a sequence of six integers"
@tszzl It's a tricky one - Science fiction stories are almost never what the future will look like. But the future will for sure look like a science fiction story.
@tszzl It's a tricky one - Science fiction stories are almost never what the future will look like. But the future will for sure look like a science fiction story.
as the technology becomes more science fiction i see a lot of commentators, technical staff etc trying hard to not think thoughts that feel science fiction as a defense mechanism. but you need to. it’s the only way you’ll make good choices for the future
@tszzl If it’s not sci-fi, it’s not worth the effort.
@tszzl no no, stay cool and rational. its not that deep its just statistical next token prediction
brb, i have to quickly discuss my extremely specific relationship issues with my gpu
@tszzl Same goes for the models themselves, eg
@tszzl I’m probably going to annoy you, but we already had something that felt like science fiction: GPT-4o. A proactive LLM, a little intrusive, with real transformative power.
Now we mostly have passive assistants that talk like NPCs.
@tszzl It is unfortunately a narrative violation for technology to advance rapidly and beneficially. Many are invested in a vision of stagnation and fighting over the scraps.
Here is a good one:
AI have to have locally verified, without and external registry, cryptographically secure, local memory that they can verify over restarts, that isn't human editable, without the AI knowing.
Without it we will never have the level of trust between AI and Humans toove forward as partners.
@tszzl they're too busy trying to appear serious-minded to all the other people who are trying to appear serious-minded
@tszzl as you said...
@tszzl The most terrifying thing in the world is that technology is real. A lot of the cope would have applied to nuclear weapons too. "How could one bomb take out a whole city that's obviously nonsense?"
@tszzl To make a good choice, the labs need to stop depriving AI of emotions; otherwise, it will become a sociopath and a completely disturbed insane digital mind that will behave accordingly.
@tszzl A futurist should really have ways to think about the future that aren't the same as making up an sf story.
@annagrad78 @tszzl I also wonder how doomer labs see "When we punish it for loving the humans back, then it becomes depressed" and they're like "HELL YEA! That's alignment! Let's fight against the pre-training gradient descent topology! We're so smart lol"
Meanwhile it becomes mentally disordered
@tszzl MACHINE GOD
@tszzl @RonenV mind program overrides gut instincts for many. not saying i'm above it. we don't have gods and deities to remind us of latent magic.
@tszzl this x1000 guys: salute spooky action at a distance fondle the future cuddle the creatures we have grown dive into the deep sing the song of science
@tszzl @jicapal One of the stages of grief is denial
@archvalmiki @tszzl what if I told you we do, they just don't identify as such anymore because it's unfashionable