The FCA's July report identifying 11 million UK adults willing to let AI make financial decisions should alarm anyone who remembers the retail investment disasters of the 2000s. The regulator is signalling — correctly — that the regulatory perimeter must expand to catch autonomous AI models deployed by financial advice platforms, robo-advisors and embedded AI assistants that currently operate in a grey zone. This matters directly to mid-market financial services firms, insurers and accountancies offering client-facing AI. If you are deploying an AI system that materially influences a client's financial decision, the FCA now intends to treat that as advice capture. Your compliance team needs to know this today.
What the FCA story reveals is a pattern: regulators globally are moving from 'AI is just a tool' to 'AI that makes autonomous decisions is an agent, and agents need accountability'. The EU AI Act already codified this distinction. UK regulators — the FCA, ICO, and SRA — are following. Meanwhile, the market is flooded with AI products that promise autonomous decision-making without friction. Harvey, Luminance and similar tools operate in knowledge-worker contexts where human judgment remains primary. But in financial advice and claims decision-making, vendors are increasingly selling fully autonomous systems — and those vendors are not building in the audit trails, decision explainability and human override mechanisms that regulation now demands.
Trovix's position is blunt: AI in regulated industries should be built with regulatory accountability first, not bolted on after. This means designing for traceability from the moment you select your AI stack. If you are using a generic large language model like Microsoft Copilot or ChatGPT as your advisory engine, you have already failed the FCA test — you cannot explain or audit the model's reasoning, and you cannot guarantee it is not reproducing bias. Trovix Aria is built specifically for this context: it constrains the AI to your own knowledge base, logs every decision path, and maintains human oversight by design. The alternative — deploying black-box LLMs and hoping compliance catches up — is not a strategy.
What should a mid-market financial services firm or insurance broker do right now? First: conduct a genuine audit of any AI system you currently use for client decisions or advice. Ask your vendor directly: can you explain every decision the model made? Can you show the training data? Can you guarantee no autonomous decisions outside your control? If the answer is evasive, you need to plan a migration. Second: use Trovix Watch to track the FCA's regulatory rulemaking in real time — the final rules are coming, and they will be specific. Third: when you rebuild or upgrade, insist on explainable, auditable AI. It will cost more upfront. It is also the only way to avoid a multi-million-pound remediation bill when the FCA enforcement wave hits.
Source: City AM