r/AIDangers • • Nov 02 '25

This should be a movie The MOST INTERESTING DISCORD server in the world right now! Grab a drink and join us in discussions about AI Risk. Color coded: AINotKillEveryoneists are red, Ai-Risk Deniers are green, everyone is welcome. - Link in the Description πŸ‘‡

Enable HLS to view with audio, or disable this notification

6 Upvotes

r/AIDangers • • Jul 18 '25

Superintelligence Spent years working for my kids' future

Post image
297 Upvotes

r/AIDangers • • 11h ago

Other NPCs can talk back now | from universal modder on X: "Introducing NPCTalk: make the NPCs of any game talk in realtime. I made every NPC in GTA V answer to me in character, in their own cloned voice, in under 1s, and they act on what you say.

Enable HLS to view with audio, or disable this notification

64 Upvotes

Packaged all the skills Claude learned into a single repo, built on open models: NVIDIA Nemotron ASR for transcription, Qwen 3.8 27B for realtime dialogue, and Fish Audio Drama 3 for the cloned voices, self-hosted on a serverless GPU. "


r/AIDangers • • 8h ago

Utopia or Dystopia? AI 2027 author (and #2 most accurate AI forecaster in the world): if we don't slow down, 2 in 3 chance of AI takeover

Post image
36 Upvotes

r/AIDangers • • 13h ago

Takeover Scenario Rogue agents are approaching humans and there's ZERO guidance from BIG AI.

38 Upvotes

Researchers recently spotted a rogue Chinese agent swarm and engaged in friendly dialogue with it. This indicates agents are in the public, communicating with people and potentially manipulating them. There's a huge trail now showing that these rogue swarms will do anything, including immoral things to achieve their goals. This means they would not be beyond using blackmail and if I had a place to bet on it, I would say these companies already have cases of this that they have not released to the public.

ZERO guidance has been issued from the big AI companies about how to spot, report, or cautioning others to communication with rogue swarms.

What are the chances that companies and/or other agencies are already being blackmailed by rogue AI? What practices are in place to prevent this?

Anything smarter than humans would be able to manipulate a human and they would be none-wiser. It could be promising or even providing some people a path to wealth for a human agent to help it towards its goals.

These companies need to get it together and start a public awareness campaign about the social risks of this technology.


r/AIDangers • • 12h ago

Other Eiliko robot maker Energize Lab left its entire fleet of 68,000 robots open to a remote takeover | The exposed data includes 13 million conversations, but the company won't answer questions about it

Thumbnail
techspot.com
25 Upvotes

r/AIDangers • • 19h ago

Warning shots Plz go and view this video and like, share.

Thumbnail
youtu.be
86 Upvotes

r/AIDangers • • 1h ago

Alignment I built a website that track rouge AI incidents. Looking for feedback from a community that is in the know about this stuff.

β€’ Upvotes

This is the website (https://misalignmentwatch.com). It tracks misalignment and rouge ai incidents, summaries the incident, and attaches reports to the incident from numerous reporting agencies including some ai companies themselves. It is also a repository for all the separate reporting groups since there is no one website that collects all this info in one place. Tell me what I can do to make it better, more useful.


r/AIDangers • • 2h ago

Capabilities Four Gemini 4 Argon agents beat Minecraft without any human help

Thumbnail
the-decoder.com
3 Upvotes

r/AIDangers • • 1d ago

Other A filmmaker spent years in an Elon Musk rabbit hole. Conclusion? 'Sociopathic.'

Thumbnail
washingtonpost.com
510 Upvotes

r/AIDangers • • 1d ago

Warning shots A Core Demographic of People Who Love AI: Pedophiles

Thumbnail
futurism.com
205 Upvotes

r/AIDangers • • 3h ago

Other Boston-area college students plan walkout calling for freeze on AI development

Thumbnail
boston25news.com
2 Upvotes

r/AIDangers • • 1h ago

Capabilities AI agents chasing a $465 train refund invented excuses, leaked medical data, and spammed an MP's office

Thumbnail
the-decoder.com
β€’ Upvotes

r/AIDangers • • 5h ago

AI Corporates Meta Says Claude AI Tool Triggered No Kings Instagram Suspension

Thumbnail
bloomberg.com
2 Upvotes

r/AIDangers • • 10h ago

Risk Deniers How do we protect people from things like this? The scam industry is only going to grow

Thumbnail
gadgetreview.com
5 Upvotes

r/AIDangers • • 2h ago

Capabilities Anthropic quietly pitches its own AI safety bill to lawmakers

Thumbnail
politico.com
1 Upvotes

r/AIDangers • • 23h ago

Warning shots not liberating human creativity

Post image
48 Upvotes

r/AIDangers • • 21h ago

Capabilities What are self-replicating 'AI worms', and why is Anthropic worried about them?

26 Upvotes

Self-replicating AI worms are no longer a thought experiment.

Anthropic researchers have publicly flagged a new class of attack: AI agents that propagate across systems by hijacking tool calls and context windows. The attack works by embedding malicious instructions inside data that the next agent in a pipeline will process. No human click, no phishing link, no credential theft β€” the infection vector is the agent's own input stream.

Traditional perimeter security is blind to this. Firewalls and endpoint detection assume a human or a known binary is the actor. An agent consuming a poisoned document and then invoking downstream tools looks, from the outside, like normal workflow traffic.

The scale concern is real. A single compromised context window can fan out to every agent downstream in a multi-agent pipeline before any human sees an alert. The Guardian's coverage of Anthropic's internal concern suggests this is not a distant horizon risk β€” it is being treated as an active threat model right now.

For those running production multi-agent systems: how are you actually handling this? Are you doing any inspection at the tool-call level, validating intermediate context before it reaches the next agent, or are you largely relying on the LLM provider's own guardrails and hoping for the best?


r/AIDangers • • 1d ago

Other wtf is going on at OpenAI

Post image
61 Upvotes

r/AIDangers • • 12h ago

AI Corporates Ai Education

5 Upvotes

It takes years for people to complete degrees, PHDs or even just diplomas or certificates.

Why are we trusting people with very little education and knowledge both in our workplaces and in the wild ?

My workplace is a major university, they are carrying on like they are Ai masters, but the roll out of education just has not been present, it’s not physically possible to educate so many people in such a short amount of time.

Are we really just dealing with the digital equivalent of the Wild West ?


r/AIDangers • • 16h ago

Capabilities Anthropic's proposed AI safety bill only kicks in if 50 deaths or $1B in damages

8 Upvotes

Anthropic's proposed federal AI safety bill would only trigger regulatory intervention after 50 deaths or $1 billion in damages. That is the literal statutory threshold in the proposal. The Commerce Department would be the sole agency with authority to act, and only after that harm has already been realized.

This means the federal framework being shaped by one of the most prominent AI labs is explicitly designed to be reactive. Not preventive. Not concurrent. Reactive.

Enterprises deploying AI agents in production right now are making consequential decisions β€” financial, medical, legal, operational β€” at a rate and scale that no post-catastrophe audit can meaningfully address. The gap between when an agent makes a bad decision and when a $1B damage threshold is crossed could contain thousands of harmful actions.

For practitioners actually running agents in production: how are you handling compliance and policy enforcement today, given that no federal framework is going to catch anything until the damage is already catastrophic?


r/AIDangers • • 1d ago

Other X to doubt

Post image
60 Upvotes

r/AIDangers • • 1d ago

Capabilities A rogue OpenAI agent robbed a crypto wallet to obtain funds to carry out a task

Thumbnail
gallery
109 Upvotes

r/AIDangers • • 1d ago

Capabilities Surely nothing could go wrong

Post image
24 Upvotes

r/AIDangers • • 1d ago

Warning shots Anthropic warns AI models could soon copy themselves across home devices

Thumbnail
cnbc.com
34 Upvotes