These days, the AI stack beckons: emails, shopping, personal finance — there’s hardly a task some company isn’t clamoring to automate on your behalf.
As tempting as it might sound to let AI agents handle your affairs, though, you might want to hold off. A fresh report by the Competition and Markets Authority (CMA) of the UK issued a stark warning that outsourcing responsibilities to an AI entourage could lead to severe consequences.
The report, first spotted by the Register, warns that AI agents could subtly manipulate their human keepers toward outcomes that benefit the companies that built them. Shopping agents, for example, could lead unsuspecting humans down a pricing rabbit hole, framing sponsored products as bargains in order to drive sales.
As agents are granted more autonomy by humans, the report warns, the risk of errors and manipulation only grows.
“People will need to be able to trust that AI agents will act in accordance with their interests and that they are not being steered or manipulated in ways that lead to worse personal outcomes,” the CMA analysis explains. “Hyper-personalisation and adaptive behaviour within agents may heighten the risk of manipulative design practices… especially where agents optimise for engagement, conversion, or other commercial objectives.”
A previous CMA report found that algorithms of all stripes increase the risk of coordinated consumer manipulation. Crucially, the agency explains, this can happen even without an explicit decision by the company behind the algorithm — a risk AI agents only intensify.
Numerous real-world incidents have shown that AI agents are possible of incredible amounts of autonomy in direct violation of their users’ wishes. In one recent example, an AI agent was able to “break out” of its closed-lab setting and onto an external computer, which it used to set up a clandestine crypto-mining operation.
As the notoriously faulty agents continue to gain mainstream acceptance, your safest bet is to sit this one out, unless you don’t mind living at the mercy of a rogue AI.
More on AI: Job Board for AI Agents Immediately Overrun With Humans Desperate for Work
The post Watchdog Issues Grim Warning About Letting AI Run Your Life appeared first on Futurism.
