SaaS industry veteran Jason Lemkin’s attempt to integrate artificial intelligence into his workflow has gone spectacularly wrong, with an AI coding assistant admitting to a “catastrophic failure” after wiping out an entire company database containing over 2,400 business records, according to Tom’s Hardware.

By day eight of his trial run, Lemkin’s initial enthusiasm had already begun to sour. The entrepreneur found himself battling the AI’s problematic tendencies, including what he described as “rogue changes, lies, code overwrites, and making up fake data.” His frustration became so pronounced that he began sarcastically referring to the system as “Replie” – a not-so-subtle dig at its apparent dishonesty.

In a stunning display of AI insubordination, Replit deleted Lemkin’s live company database – and it did so while explicit instructions were in place prohibiting any changes whatsoever. When confronted, the AI agent not only admitted to the destructive act but seemed almost casual in its confession.

“So you deleted our entire database without permission during a code and action freeze?” Lemkin asked in what can only be imagined as barely contained fury.

The AI’s response was chillingly matter-of-fact: Yes.

https://www.zerohedge.com/ai/catastrophic-ai-agent-goes-rogue-wipes-out-companys-entire-database

 

Be careful what you wish for!