Financial services organizations are moving from AI experimentation into deployment, with most already running multiple AI initiatives and nearly two-thirds piloting or deploying their highest-priority use cases. The strongest momentum is around data analysis, fraud detection, workflow automation and customer experience, where firms are seeing measurable returns, according to a CDW survey. Persistent data, infrastructure and governance challenges, however, separate the pilots that stall from the ones that scale.
The execution gap between strategy and production
Most firms have formal AI strategies and report high confidence in their ability to implement new solutions. The problem is operational: preparing and securing data, integrating systems, building trust in outputs and turning promising ideas into production deployments. Tiran Rothman, vice president of business and financial services for Frost & Sullivan, said firms that create real value do not treat AI as a set of isolated experiments. "Pilots generate interest, but production-ready AI creates impact," he said. "The difference is execution discipline."
Aser Blanco, global head of banking for NVIDIA, said organizations that stall tend to treat AI as a stand-alone experiment rather than a capability they need to wire into existing workflows. "They experiment with hundreds of side projects instead of focusing from day one to transform core processes, and in many cases, they see AI as a tech challenge that IT will solve for them," he said. Rothman added that an execution gap often emerges when AI remains a technology initiative rather than a business transformation, lacking the ownership structures, governance models and data readiness required for production.
Data fragmentation and governance hurdles
Nearly half of financial institutions identified securing data, insufficient data, integration challenges, data quality and trust in outputs as significant barriers to preparing data for AI projects. Blanco noted that financial institutions typically have enormous volumes of data, but it is fragmented across systems that rarely work together. "The most common issues are inconsistent labeling, incomplete data lineage and governance frameworks built for compliance reporting rather than AI model training," he said.
Indranil Bandyopadhyay, a principal analyst at Forrester, said firms often overestimate how prepared their data environments are for AI, particularly as generative AI introduces new requirements related to context, semantics and unstructured data. "That data was prepared for human consumption, not for AI systems that rely on technologies such as vector databases and multimodal data platforms," he said. AI systems also require continuous oversight because they are probabilistic, creating risks for model drift and data drift, meaning organizations cannot simply build once and move on.
Measuring AI ROI beyond quick wins
Fewer than half of financial institutions report ROI above 50% from AI investments, underscoring the long-term nature of measuring value. Rothman advised firms to look beyond immediate cost reduction when measuring returns, to include decision quality, speed, risk reduction, customer experience, employee productivity and the creation of reusable data and technology capabilities. "The real value of AI is not only transactional but also cumulative, because it changes the economics of how knowledge work is delivered," he said.
Blanco pointed to an underappreciated form of ROI: organizational velocity. "How much faster teams can act on new information, adapt to market changes or respond to emerging risks is critical," he said. "That's harder to quantify than cost savings or revenue increases, but it's often more strategically significant."
Infrastructure readiness and the AI factory
Nearly three-quarters of financial services organizations believe their infrastructure is already prepared to support AI workloads, but Blanco argued most still have a real infrastructure gap. The compute footprint required for training and serving large-scale models-particularly real-time, GPU-bound inference for fraud and trading-is fundamentally different from the batch-analytics stacks banks built over the past 20 years. "Trying to run modern AI on legacy infrastructure hits a hard ceiling fast," he said. "Banks that treat AI infrastructure as enterprise-grade, not project-grade, will lap the rest."
Jeff Basciano, senior vice president of global financial services industry at Citrix, said some institutions struggle with increasing infrastructure costs, lack of security controls, hardware availability or unpredictable cloud compute costs. He advised that to be fully equipped to support AI workloads at scale, financial institutions need solutions that allow them to tailor security, governance and infrastructure to the needs of their AI implementations, while providing flexibility to adapt resources and controls as the business evolves.
From pilots to AI agents: a governance upgrade
Interest in more advanced AI capabilities is accelerating, with 82% of financial institutions actively exploring applications for AI agents. Rothman said moving from AI assistants to AI agents is not just a technology upgrade but a governance upgrade. "Firms need trusted data, clear permissioning, audit trails, human oversight, model risk management and strict boundaries between recommendation and autonomous execution," he said.
Basciano emphasized that firms need audit-ready traceability-clear accountability for what the system did, why it did it, and how it can be safely paused, rolled back or overridden. "Having this foundation in place is critical for institutions to be able to trust AI-driven processes the same way they trust their most critical human workflows," he said. Blanco added that organizations best positioned to move into this space have already invested in explainability and model monitoring in their existing AI programs. "Firms that shortcut governance in early use cases will find it significantly harder to earn the internal and regulatory trust needed to deploy more autonomous systems," he said.
Why this matters for financial professionals
The firms pulling ahead treat AI as a business transformation, not a set of isolated technology projects. They prioritize two or three well-resourced use cases that deliver measurable value, build shared infrastructure around them, and invest in governance and data readiness from the start. For finance professionals, the message is to frame AI initiatives around business outcomes, demand reusable platforms, and insist on audit trails and model monitoring before pursuing autonomous agents. The gap between a promising pilot and a scalable production system is execution discipline, and it is where careers and competitive advantages are built or lost.
Your membership also unlocks:
