Insurers Step Up Coverage for AI-Related Errors
Lloyd’s of London has introduced a new insurance product aimed at companies facing losses due to artificial intelligence (AI) malfunctions. Offered through the startup Armilla, this insurance covers legal claims if a business is sued by customers or third parties harmed by faulty AI products.
This launch comes as companies increasingly rely on AI tools like chatbots, which can sometimes produce confident but incorrect information—known as hallucinations. These errors have led to costly mistakes and damaged reputations, raising questions about who is responsible when AI systems fail.
Accountability Challenges in AI Usage
Kelwin Fernandes, CEO of NILG.AI, highlights a key issue: when humans delegate decisions to AI or remove themselves from processes, assigning liability becomes complex. Usually, the company behind the AI takes on the responsibility.
Examples include Virgin Money apologizing after its chatbot misinterpreted a customer’s language, and Air Canada facing legal action when its chatbot falsely promised a discount. Armilla’s insurance would have covered Air Canada’s losses if the chatbot were found at fault.
How Financial Institutions Are Handling AI Risks
Lloyds Bank, cautious about AI hallucinations, initially limited AI use to back-office tasks or kept human oversight in place. According to Ranil Boteju, the bank’s Chief Data and Analytics Officer, they avoided exposing generative AI tools directly to customers until they were confident in safety measures.
What This Means for Customer Support and Insurance Professionals
- AI-related mistakes can trigger legal claims and financial losses, making insurance coverage essential.
- Clear policies and guardrails are necessary to control AI risks, especially in customer-facing roles.
- Understanding available insurance products like Armilla’s offering can help companies manage AI liability.
- Human oversight remains critical to catch AI errors before they affect customers.
For customer support teams and insurance professionals, staying informed about AI risks and insurance options is key to minimizing exposure. Exploring AI training can also aid in managing and monitoring AI tools effectively. You can find relevant courses on Complete AI Training.
Your membership also unlocks:
